Skip to content

perf: remove ExecutionCtx from OperationsVTable::scalar_at#7417

Closed
0ax1 wants to merge 3 commits intodevelopfrom
ad/remove-ctx-from-scalar-at
Closed

perf: remove ExecutionCtx from OperationsVTable::scalar_at#7417
0ax1 wants to merge 3 commits intodevelopfrom
ad/remove-ctx-from-scalar-at

Conversation

@0ax1
Copy link
Copy Markdown
Contributor

@0ax1 0ax1 commented Apr 13, 2026

Summary

  • Removes all usages of ExecutionCtx in scalar_at

Profiling

Profiled with apmc. ClickBench, Vortex format, Apple Silicon M4 Max, 3 iterations:

Metric Before After Delta
Cycles 1,973.5B 1,942.6B -1.6%
Instructions 4,730.2B 4,722.5B -0.16%
IPC 2.40 2.43 +1.25%
Wall clock 43.09s 41.92s -2.7%
Dispatch stalls 593.7B 573.9B -3.3%
L1D cache misses 80.7B 80.6B ~0%
Branch mispredicts 11.2B 11.2B ~0%

The scalar_at hot path was creating and dropping an ExecutionCtx on
every call via LEGACY_SESSION.create_execution_ctx(). Each creation
involves an atomic fetch_add + Arc clone, and each drop an Arc release.
This was called millions of times during query execution (primarily from
PrimitiveTyped::value_unchecked during search_sorted and patches).

Only Patched::scalar_at actually uses ctx (for .execute()), so move the
ctx creation there. All other implementations had unused `_ctx` params.

Profiled with apmc (Apple Silicon hardware performance counters).
ClickBench (Vortex format, Apple Silicon M4 Max, 3 iterations):

  Metric               Before          After           Delta
  Cycles               1,973.5B        1,942.6B        -1.6%
  Instructions         4,730.2B        4,722.5B        -0.16%
  IPC                  2.40            2.43            +1.25%
  Wall clock           43.09s          41.92s          -2.7%
  Dispatch stalls      593.7B          573.9B          -3.3%
  L1D cache misses     80.7B           80.6B           ~0%
  Branch mispredicts   11.2B           11.2B           ~0%

Signed-off-by: Alexander Droste <droste.alexander@gmail.com>

Signed-off-by: Alexander Droste <alexander.droste@protonmail.com>
@0ax1 0ax1 added changelog/performance A performance improvement action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Apr 13, 2026
@0ax1 0ax1 requested review from a10y and gatesn April 13, 2026 17:42
@0ax1 0ax1 changed the title perf: remove ExecutionCtx from OperationsVTable::scalar_at perf: remove ExecutionCtx from OperationsVTable::scalar_at Apr 13, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 13, 2026
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Apr 13, 2026

Merging this PR will degrade performance by 22.79%

⚡ 4 improved benchmarks
❌ 2 regressed benchmarks
✅ 1117 untouched benchmarks
⏩ 1455 skipped benchmarks1

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation case_when_all_false[1000] 85 µs 108.1 µs -21.37%
Simulation case_when_fragmented[100] 155.1 µs 133.3 µs +16.33%
Simulation scalar_at_struct_simple 594.8 µs 526.6 µs +12.96%
Simulation scalar_at_struct_wide 2.7 ms 2.4 ms +14.31%
Simulation patched_take_10k_first_chunk_only 329.9 µs 271.1 µs +21.69%
Simulation null_count_run_end[(10000, 4, 0.01)] 104.2 µs 135 µs -22.79%

Comparing ad/remove-ctx-from-scalar-at (242101f) with develop (71089dd)

Open in CodSpeed

Footnotes

  1. 1455 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 13, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done c0adb3e 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.6%
Vortex (geomean): 0.992x ➖
Parquet (geomean): 0.990x ➖
Shifts: Parquet (control) -1.0% · Median polish -0.4%


datafusion / vortex-file-compressed (0.990x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 49149014 49688925 0.99
tpch_q02/datafusion:vortex-file-compressed 33299217 32041245 1.04
tpch_q03/datafusion:vortex-file-compressed 26326794 26058090 1.01
tpch_q04/datafusion:vortex-file-compressed 17973464 17745860 1.01
tpch_q05/datafusion:vortex-file-compressed 53103119 52770677 1.01
tpch_q06/datafusion:vortex-file-compressed 9658748 10319055 0.94
tpch_q07/datafusion:vortex-file-compressed 62655550 63546842 0.99
tpch_q08/datafusion:vortex-file-compressed 44982458 43244485 1.04
tpch_q09/datafusion:vortex-file-compressed 54836989 55658399 0.99
tpch_q10/datafusion:vortex-file-compressed 43044060 42585269 1.01
tpch_q11/datafusion:vortex-file-compressed 17396007 17623982 0.99
tpch_q12/datafusion:vortex-file-compressed 22097818 23089662 0.96
tpch_q13/datafusion:vortex-file-compressed 26829911 27511266 0.98
tpch_q14/datafusion:vortex-file-compressed 15526723 16710463 0.93
tpch_q15/datafusion:vortex-file-compressed 24814935 24631846 1.01
tpch_q16/datafusion:vortex-file-compressed 23759489 24702593 0.96
tpch_q17/datafusion:vortex-file-compressed 63602744 64170791 0.99
tpch_q18/datafusion:vortex-file-compressed 76930384 77549970 0.99
tpch_q19/datafusion:vortex-file-compressed 21533428 21266976 1.01
tpch_q20/datafusion:vortex-file-compressed 31954847 32738793 0.98
tpch_q21/datafusion:vortex-file-compressed 73595085 73833560 1.00
tpch_q22/datafusion:vortex-file-compressed 15588686 15707644 0.99
datafusion / vortex-compact (0.994x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 55218165 56886933 0.97
tpch_q02/datafusion:vortex-compact 35539335 36292861 0.98
tpch_q03/datafusion:vortex-compact 30891889 31111910 0.99
tpch_q04/datafusion:vortex-compact 22810171 22733116 1.00
tpch_q05/datafusion:vortex-compact 55588996 56214501 0.99
tpch_q06/datafusion:vortex-compact 13218281 12649468 1.04
tpch_q07/datafusion:vortex-compact 67044994 70228687 0.95
tpch_q08/datafusion:vortex-compact 50024654 49908827 1.00
tpch_q09/datafusion:vortex-compact 60204320 61796292 0.97
tpch_q10/datafusion:vortex-compact 50996889 51958475 0.98
tpch_q11/datafusion:vortex-compact 19054032 19750009 0.96
tpch_q12/datafusion:vortex-compact 31596372 32161706 0.98
tpch_q13/datafusion:vortex-compact 35667782 36089127 0.99
tpch_q14/datafusion:vortex-compact 20168495 20249905 1.00
tpch_q15/datafusion:vortex-compact 33350616 34188644 0.98
tpch_q16/datafusion:vortex-compact 29208659 28976417 1.01
tpch_q17/datafusion:vortex-compact 68991090 70122133 0.98
tpch_q18/datafusion:vortex-compact 84599518 87506192 0.97
tpch_q19/datafusion:vortex-compact 32881656 32152414 1.02
tpch_q20/datafusion:vortex-compact 37713697 37700597 1.00
tpch_q21/datafusion:vortex-compact 88250461 87461433 1.01
tpch_q22/datafusion:vortex-compact 18280362 16646953 1.10
datafusion / parquet (1.041x ➖, 0↑ 3↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 135353204 97461012 1.39
tpch_q02/datafusion:parquet 70530507 69210466 1.02
tpch_q03/datafusion:parquet 80568682 79377705 1.02
tpch_q04/datafusion:parquet 49457675 48044393 1.03
tpch_q05/datafusion:parquet 107014214 103412642 1.03
tpch_q06/datafusion:parquet 44400730 42135696 1.05
tpch_q07/datafusion:parquet 117882656 111335034 1.06
tpch_q08/datafusion:parquet 108975914 105462759 1.03
tpch_q09/datafusion:parquet 144076928 135575799 1.06
tpch_q10/datafusion:parquet 123665017 122052272 1.01
tpch_q11/datafusion:parquet 51105440 48495710 1.05
tpch_q12/datafusion:parquet 95354778 89816463 1.06
tpch_q13/datafusion:parquet 🚨 232146794 208433562 1.11
tpch_q14/datafusion:parquet 46567289 51090007 0.91
tpch_q15/datafusion:parquet 69301165 66957869 1.03
tpch_q16/datafusion:parquet 🚨 57618855 50129770 1.15
tpch_q17/datafusion:parquet 136915839 142729278 0.96
tpch_q18/datafusion:parquet 173575717 165100769 1.05
tpch_q19/datafusion:parquet 85791999 91575050 0.94
tpch_q20/datafusion:parquet 74716213 75714777 0.99
tpch_q21/datafusion:parquet 153062365 148115526 1.03
tpch_q22/datafusion:parquet 34634719 35441955 0.98
datafusion / arrow (1.081x ➖, 0↑ 8↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚨 60291484 53331833 1.13
tpch_q02/datafusion:arrow 22198428 22326565 0.99
tpch_q03/datafusion:arrow 34190445 32403452 1.06
tpch_q04/datafusion:arrow 28497645 27371389 1.04
tpch_q05/datafusion:arrow 80837773 80670431 1.00
tpch_q06/datafusion:arrow 20579886 21324692 0.97
tpch_q07/datafusion:arrow 114063022 111843156 1.02
tpch_q08/datafusion:arrow 46484487 45708858 1.02
tpch_q09/datafusion:arrow 73010657 68486090 1.07
tpch_q10/datafusion:arrow 55905311 50971737 1.10
tpch_q11/datafusion:arrow 12190219 11364292 1.07
tpch_q12/datafusion:arrow 🚨 66935799 53704365 1.25
tpch_q13/datafusion:arrow 🚨 53566341 47914655 1.12
tpch_q14/datafusion:arrow 🚨 25279241 22121558 1.14
tpch_q15/datafusion:arrow 🚨 51004552 43960740 1.16
tpch_q16/datafusion:arrow 🚨 22518312 20340028 1.11
tpch_q17/datafusion:arrow 🚨 80368603 70220552 1.14
tpch_q18/datafusion:arrow 🚨 162712334 141672593 1.15
tpch_q19/datafusion:arrow 43606440 40075741 1.09
tpch_q20/datafusion:arrow 41622180 38272243 1.09
tpch_q21/datafusion:arrow 169105108 154945631 1.09
tpch_q22/datafusion:arrow 20728386 20081195 1.03
duckdb / vortex-file-compressed (0.988x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 33565713 33199221 1.01
tpch_q02/duckdb:vortex-file-compressed 26984626 28224285 0.96
tpch_q03/duckdb:vortex-file-compressed 28666918 28892152 0.99
tpch_q04/duckdb:vortex-file-compressed 30137689 28802817 1.05
tpch_q05/duckdb:vortex-file-compressed 33859828 34049188 0.99
tpch_q06/duckdb:vortex-file-compressed 10369915 10424554 0.99
tpch_q07/duckdb:vortex-file-compressed 36955357 36996495 1.00
tpch_q08/duckdb:vortex-file-compressed 40315183 40766744 0.99
tpch_q09/duckdb:vortex-file-compressed 74338406 80524938 0.92
tpch_q10/duckdb:vortex-file-compressed 35271967 35891752 0.98
tpch_q11/duckdb:vortex-file-compressed 16610274 16121891 1.03
tpch_q12/duckdb:vortex-file-compressed 22414184 22643891 0.99
tpch_q13/duckdb:vortex-file-compressed 37731697 37172077 1.02
tpch_q14/duckdb:vortex-file-compressed 21249917 21203120 1.00
tpch_q15/duckdb:vortex-file-compressed 16194118 15979575 1.01
tpch_q16/duckdb:vortex-file-compressed 29180248 30497315 0.96
tpch_q17/duckdb:vortex-file-compressed 25071500 25969051 0.97
tpch_q18/duckdb:vortex-file-compressed 46302653 47295290 0.98
tpch_q19/duckdb:vortex-file-compressed 30495439 31992362 0.95
tpch_q20/duckdb:vortex-file-compressed 33438068 34944169 0.96
tpch_q21/duckdb:vortex-file-compressed 101471344 101897717 1.00
tpch_q22/duckdb:vortex-file-compressed 17817254 17854897 1.00
duckdb / vortex-compact (0.994x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38315777 39565410 0.97
tpch_q02/duckdb:vortex-compact 35889365 37409882 0.96
tpch_q03/duckdb:vortex-compact 31869337 31387486 1.02
tpch_q04/duckdb:vortex-compact 33148953 34284153 0.97
tpch_q05/duckdb:vortex-compact 37942719 37860036 1.00
tpch_q06/duckdb:vortex-compact 15040168 13998123 1.07
tpch_q07/duckdb:vortex-compact 41394795 41843725 0.99
tpch_q08/duckdb:vortex-compact 43838632 45734767 0.96
tpch_q09/duckdb:vortex-compact 88477975 90065374 0.98
tpch_q10/duckdb:vortex-compact 39017986 40511786 0.96
tpch_q11/duckdb:vortex-compact 19619823 20804868 0.94
tpch_q12/duckdb:vortex-compact 34997687 35868707 0.98
tpch_q13/duckdb:vortex-compact 45731430 45862159 1.00
tpch_q14/duckdb:vortex-compact 29288096 28756424 1.02
tpch_q15/duckdb:vortex-compact 19065130 19235156 0.99
tpch_q16/duckdb:vortex-compact 37309659 36028642 1.04
tpch_q17/duckdb:vortex-compact 31116244 30391791 1.02
tpch_q18/duckdb:vortex-compact 51403643 50465820 1.02
tpch_q19/duckdb:vortex-compact 37298636 36793955 1.01
tpch_q20/duckdb:vortex-compact 42725018 42696627 1.00
tpch_q21/duckdb:vortex-compact 110604224 111144187 1.00
tpch_q22/duckdb:vortex-compact 20466371 20916220 0.98
duckdb / parquet (0.942x ➖, 6↑ 1↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚀 75496660 117502219 0.64
tpch_q02/duckdb:parquet 39229107 40167929 0.98
tpch_q03/duckdb:parquet 68999362 69009172 1.00
tpch_q04/duckdb:parquet 47493576 47089387 1.01
tpch_q05/duckdb:parquet 66469112 68237401 0.97
tpch_q06/duckdb:parquet 🚨 28819370 21944576 1.31
tpch_q07/duckdb:parquet 🚀 67277999 83242656 0.81
tpch_q08/duckdb:parquet 🚀 82842710 100399108 0.83
tpch_q09/duckdb:parquet 152722278 157069268 0.97
tpch_q10/duckdb:parquet 136815593 126659386 1.08
tpch_q11/duckdb:parquet 21635385 22279503 0.97
tpch_q12/duckdb:parquet 🚀 44892872 55709254 0.81
tpch_q13/duckdb:parquet 262078646 270328385 0.97
tpch_q14/duckdb:parquet 🚀 47890404 60504174 0.79
tpch_q15/duckdb:parquet 24053879 24312353 0.99
tpch_q16/duckdb:parquet 54561716 54932936 0.99
tpch_q17/duckdb:parquet 51922531 54878747 0.95
tpch_q18/duckdb:parquet 118897240 118559861 1.00
tpch_q19/duckdb:parquet 68895587 69601473 0.99
tpch_q20/duckdb:parquet 🚀 64127768 73745736 0.87
tpch_q21/duckdb:parquet 174568593 177152545 0.99
tpch_q22/duckdb:parquet 51887628 51650285 1.00
duckdb / duckdb (0.996x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16308538 16014280 1.02
tpch_q02/duckdb:duckdb 12024344 12412438 0.97
tpch_q03/duckdb:duckdb 19122682 19348244 0.99
tpch_q04/duckdb:duckdb 18909138 19499923 0.97
tpch_q05/duckdb:duckdb 20237534 20133871 1.01
tpch_q06/duckdb:duckdb 5300651 5479000 0.97
tpch_q07/duckdb:duckdb 22644250 23103773 0.98
tpch_q08/duckdb:duckdb 20742503 20623089 1.01
tpch_q09/duckdb:duckdb 54970548 56942074 0.97
tpch_q10/duckdb:duckdb 45855060 41811039 1.10
tpch_q11/duckdb:duckdb 5723882 6006731 0.95
tpch_q12/duckdb:duckdb 13948871 13598857 1.03
tpch_q13/duckdb:duckdb 37567571 38508793 0.98
tpch_q14/duckdb:duckdb 16175265 16343566 0.99
tpch_q15/duckdb:duckdb 11662156 11670289 1.00
tpch_q16/duckdb:duckdb 23316383 22884377 1.02
tpch_q17/duckdb:duckdb 13558029 13583040 1.00
tpch_q18/duckdb:duckdb 38380775 38613527 0.99
tpch_q19/duckdb:duckdb 27927160 27924342 1.00
tpch_q20/duckdb:duckdb 22956406 22653576 1.01
tpch_q21/duckdb:duckdb 54966383 56104193 0.98
tpch_q22/duckdb:duckdb 24417104 24427764 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +13.0% -5.5% +19.7% +31.6% ➖ noise
1 datafusion:vortex-compact -2.9% -5.5% +2.8% +31.4% ➖ noise
1 datafusion:vortex-file-compressed -1.1% -5.5% +4.7% +32.7% ➖ noise
1 duckdb:duckdb +1.8% -5.5% +7.8% +30.4% ➖ noise
1 duckdb:vortex-compact -3.2% -5.5% +2.5% +30.3% ➖ noise
1 duckdb:vortex-file-compressed +1.1% -5.5% +7.0% +29.9% ➖ noise
2 datafusion:arrow -0.6% -0.2% -0.3% +18.6% ➖ noise
2 datafusion:vortex-compact -2.1% -0.2% -1.8% +18.6% ➖ noise
2 datafusion:vortex-file-compressed +3.9% -0.2% +4.2% +18.6% ➖ noise
2 duckdb:duckdb -3.1% -0.2% -2.9% +18.6% ➖ noise
2 duckdb:vortex-compact -4.1% -0.2% -3.8% +18.6% ➖ noise
2 duckdb:vortex-file-compressed -4.4% -0.2% -4.2% +18.6% ➖ noise
3 datafusion:arrow +5.5% +0.7% +4.7% +18.6% ➖ noise
3 datafusion:vortex-compact -0.7% +0.7% -1.4% +18.6% ➖ noise
3 datafusion:vortex-file-compressed +1.0% +0.7% +0.3% +18.6% ➖ noise
3 duckdb:duckdb -1.2% +0.7% -1.9% +18.6% ➖ noise
3 duckdb:vortex-compact +1.5% +0.7% +0.8% +18.6% ➖ noise
3 duckdb:vortex-file-compressed -0.8% +0.7% -1.5% +18.6% ➖ noise
4 datafusion:arrow +4.1% +1.9% +2.2% +18.6% ➖ noise
4 datafusion:vortex-compact +0.3% +1.9% -1.5% +18.6% ➖ noise
4 datafusion:vortex-file-compressed +1.3% +1.9% -0.6% +18.6% ➖ noise
4 duckdb:duckdb -3.0% +1.9% -4.8% +18.6% ➖ noise
4 duckdb:vortex-compact -3.3% +1.9% -5.1% +18.6% ➖ noise
4 duckdb:vortex-file-compressed +4.6% +1.9% +2.7% +18.6% ➖ noise
5 datafusion:arrow +0.2% +0.4% -0.2% +18.6% ➖ noise
5 datafusion:vortex-compact -1.1% +0.4% -1.5% +18.6% ➖ noise
5 datafusion:vortex-file-compressed +0.6% +0.4% +0.2% +18.6% ➖ noise
5 duckdb:duckdb +0.5% +0.4% +0.1% +18.6% ➖ noise
5 duckdb:vortex-compact +0.2% +0.4% -0.2% +18.6% ➖ noise
5 duckdb:vortex-file-compressed -0.6% +0.4% -1.0% +18.6% ➖ noise
6 datafusion:arrow -3.5% +17.6% -18.0% +25.4% ➖ noise
6 datafusion:vortex-compact +4.5% +17.6% -11.2% +25.2% ➖ noise
6 datafusion:vortex-file-compressed -6.4% +17.6% -20.4% +25.4% ✅ faster
6 duckdb:duckdb -3.3% +17.6% -17.8% +29.0% ➖ noise
6 duckdb:vortex-compact +7.4% +17.6% -8.7% +28.2% ➖ noise
6 duckdb:vortex-file-compressed -0.5% +17.6% -15.4% +26.0% ➖ noise
7 datafusion:arrow +2.0% -7.5% +10.2% +18.6% ➖ noise
7 datafusion:vortex-compact -4.5% -7.5% +3.2% +18.6% ➖ noise
7 datafusion:vortex-file-compressed -1.4% -7.5% +6.6% +18.6% ➖ noise
7 duckdb:duckdb -2.0% -7.5% +6.0% +18.6% ➖ noise
7 duckdb:vortex-compact -1.1% -7.5% +6.9% +18.6% ➖ noise
7 duckdb:vortex-file-compressed -0.1% -7.5% +8.0% +18.6% ➖ noise
8 datafusion:arrow +1.7% -7.7% +10.1% +18.6% ➖ noise
8 datafusion:vortex-compact +0.2% -7.7% +8.5% +18.6% ➖ noise
8 datafusion:vortex-file-compressed +4.0% -7.7% +12.7% +18.6% ➖ noise
8 duckdb:duckdb +0.6% -7.7% +8.9% +18.6% ➖ noise
8 duckdb:vortex-compact -4.1% -7.7% +3.8% +18.6% ➖ noise
8 duckdb:vortex-file-compressed -1.1% -7.7% +7.1% +18.6% ➖ noise
9 datafusion:arrow +6.6% +1.7% +4.9% +18.6% ➖ noise
9 datafusion:vortex-compact -2.6% +1.7% -4.2% +18.6% ➖ noise
9 datafusion:vortex-file-compressed -1.5% +1.7% -3.1% +18.6% ➖ noise
9 duckdb:duckdb -3.5% +1.7% -5.0% +18.6% ➖ noise
9 duckdb:vortex-compact -1.8% +1.7% -3.4% +18.6% ➖ noise
9 duckdb:vortex-file-compressed -7.7% +1.7% -9.2% +18.6% ➖ noise
10 datafusion:arrow +9.7% +4.6% +4.8% +18.6% ➖ noise
10 datafusion:vortex-compact -1.9% +4.6% -6.2% +18.6% ➖ noise
10 datafusion:vortex-file-compressed +1.1% +4.6% -3.4% +18.6% ➖ noise
10 duckdb:duckdb +9.7% +4.6% +4.8% +18.7% ➖ noise
10 duckdb:vortex-compact -3.7% +4.6% -7.9% +18.6% ➖ noise
10 duckdb:vortex-file-compressed -1.7% +4.6% -6.1% +18.6% ➖ noise
11 datafusion:arrow +7.3% +1.2% +6.0% +18.6% ➖ noise
11 datafusion:vortex-compact -3.5% +1.2% -4.6% +18.6% ➖ noise
11 datafusion:vortex-file-compressed -1.3% +1.2% -2.4% +18.6% ➖ noise
11 duckdb:duckdb -4.7% +1.2% -5.8% +18.6% ➖ noise
11 duckdb:vortex-compact -5.7% +1.2% -6.8% +18.6% ➖ noise
11 duckdb:vortex-file-compressed +3.0% +1.2% +1.8% +18.6% ➖ noise
12 datafusion:arrow +24.6% -7.5% +34.8% +20.3% 🚨 regression
12 datafusion:vortex-compact -1.8% -7.5% +6.2% +18.6% ➖ noise
12 datafusion:vortex-file-compressed -4.3% -7.5% +3.5% +18.6% ➖ noise
12 duckdb:duckdb +2.6% -7.5% +10.9% +18.6% ➖ noise
12 duckdb:vortex-compact -2.4% -7.5% +5.5% +18.6% ➖ noise
12 duckdb:vortex-file-compressed -1.0% -7.5% +7.0% +18.6% ➖ noise
13 datafusion:arrow +11.8% +3.9% +7.6% +18.6% ➖ noise
13 datafusion:vortex-compact -1.2% +3.9% -4.9% +18.6% ➖ noise
13 datafusion:vortex-file-compressed -2.5% +3.9% -6.1% +18.6% ➖ noise
13 duckdb:duckdb -2.4% +3.9% -6.1% +18.6% ➖ noise
13 duckdb:vortex-compact -0.3% +3.9% -4.0% +18.6% ➖ noise
13 duckdb:vortex-file-compressed +1.5% +3.9% -2.3% +18.6% ➖ noise
14 datafusion:arrow +14.3% -15.1% +34.5% +18.6% 🚨 regression
14 datafusion:vortex-compact -0.4% -15.1% +17.3% +18.6% ➖ noise
14 datafusion:vortex-file-compressed -7.1% -15.1% +9.4% +18.6% ➖ noise
14 duckdb:duckdb -1.0% -15.1% +16.5% +23.2% ➖ noise
14 duckdb:vortex-compact +1.8% -15.1% +19.9% +18.6% 🚨 regression
14 duckdb:vortex-file-compressed +0.2% -15.1% +18.0% +20.6% ➖ noise
15 datafusion:arrow +16.0% +1.2% +14.7% +18.6% ➖ noise
15 datafusion:vortex-compact -2.5% +1.2% -3.6% +18.6% ➖ noise
15 datafusion:vortex-file-compressed +0.7% +1.2% -0.4% +18.6% ➖ noise
15 duckdb:duckdb -0.1% +1.2% -1.2% +18.6% ➖ noise
15 duckdb:vortex-compact -0.9% +1.2% -2.1% +18.6% ➖ noise
15 duckdb:vortex-file-compressed +1.3% +1.2% +0.1% +18.6% ➖ noise
16 datafusion:arrow +10.7% +6.8% +3.6% +18.6% ➖ noise
16 datafusion:vortex-compact +0.8% +6.8% -5.7% +18.6% ➖ noise
16 datafusion:vortex-file-compressed -3.8% +6.8% -10.0% +18.6% ➖ noise
16 duckdb:duckdb +1.9% +6.8% -4.6% +18.6% ➖ noise
16 duckdb:vortex-compact +3.6% +6.8% -3.1% +18.6% ➖ noise
16 duckdb:vortex-file-compressed -4.3% +6.8% -10.5% +18.6% ➖ noise
17 datafusion:arrow +14.5% -4.7% +20.1% +18.6% 🚨 regression
17 datafusion:vortex-compact -1.6% -4.7% +3.3% +18.6% ➖ noise
17 datafusion:vortex-file-compressed -0.9% -4.7% +4.0% +18.6% ➖ noise
17 duckdb:duckdb -0.2% -4.7% +4.8% +18.6% ➖ noise
17 duckdb:vortex-compact +2.4% -4.7% +7.5% +18.9% ➖ noise
17 duckdb:vortex-file-compressed -3.5% -4.7% +1.3% +23.6% ➖ noise
18 datafusion:arrow +14.9% +2.7% +11.9% +18.6% ➖ noise
18 datafusion:vortex-compact -3.3% +2.7% -5.8% +18.6% ➖ noise
18 datafusion:vortex-file-compressed -0.8% +2.7% -3.4% +18.6% ➖ noise
18 duckdb:duckdb -0.6% +2.7% -3.2% +18.6% ➖ noise
18 duckdb:vortex-compact +1.9% +2.7% -0.8% +18.6% ➖ noise
18 duckdb:vortex-file-compressed -2.1% +2.7% -4.7% +18.6% ➖ noise
19 datafusion:arrow +8.8% -3.7% +13.0% +18.6% ➖ noise
19 datafusion:vortex-compact +2.3% -3.7% +6.2% +18.6% ➖ noise
19 datafusion:vortex-file-compressed +1.3% -3.7% +5.1% +18.6% ➖ noise
19 duckdb:duckdb +0.0% -3.7% +3.9% +19.2% ➖ noise
19 duckdb:vortex-compact +1.4% -3.7% +5.3% +18.6% ➖ noise
19 duckdb:vortex-file-compressed -4.7% -3.7% -1.0% +18.6% ➖ noise
20 datafusion:arrow +8.8% -7.4% +17.4% +18.6% ➖ noise
20 datafusion:vortex-compact +0.0% -7.4% +8.0% +18.6% ➖ noise
20 datafusion:vortex-file-compressed -2.4% -7.4% +5.4% +18.6% ➖ noise
20 duckdb:duckdb +1.3% -7.4% +9.4% +18.6% ➖ noise
20 duckdb:vortex-compact +0.1% -7.4% +8.0% +18.6% ➖ noise
20 duckdb:vortex-file-compressed -4.3% -7.4% +3.3% +20.5% ➖ noise
21 datafusion:arrow +9.1% +0.9% +8.2% +18.6% ➖ noise
21 datafusion:vortex-compact +0.9% +0.9% -0.0% +18.6% ➖ noise
21 datafusion:vortex-file-compressed -0.3% +0.9% -1.2% +18.6% ➖ noise
21 duckdb:duckdb -2.0% +0.9% -2.9% +18.6% ➖ noise
21 duckdb:vortex-compact -0.5% +0.9% -1.4% +18.6% ➖ noise
21 duckdb:vortex-file-compressed -0.4% +0.9% -1.3% +18.6% ➖ noise
22 datafusion:arrow +3.2% -0.9% +4.2% +18.6% ➖ noise
22 datafusion:vortex-compact +9.8% -0.9% +10.8% +18.6% ➖ noise
22 datafusion:vortex-file-compressed -0.8% -0.9% +0.2% +18.6% ➖ noise
22 duckdb:duckdb -0.0% -0.9% +0.9% +18.6% ➖ noise
22 duckdb:vortex-compact -2.2% -0.9% -1.2% +18.6% ➖ noise
22 duckdb:vortex-file-compressed -0.2% -0.9% +0.7% +18.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.007x ➖


datafusion / vortex-file-compressed (1.007x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 122852390 120462682 1.02
polarsignals_q01/datafusion:vortex-file-compressed 370737259 361243443 1.03
polarsignals_q02/datafusion:vortex-file-compressed 21644383 21022404 1.03
polarsignals_q03/datafusion:vortex-file-compressed 371881005 364717177 1.02
polarsignals_q04/datafusion:vortex-file-compressed 10859519 11117134 0.98
polarsignals_q05/datafusion:vortex-file-compressed 15988430 15279385 1.05
polarsignals_q06/datafusion:vortex-file-compressed 18503134 17982656 1.03
polarsignals_q07/datafusion:vortex-file-compressed 13393234 13020429 1.03
polarsignals_q08/datafusion:vortex-file-compressed 444393293 459699279 0.97
polarsignals_q09/datafusion:vortex-file-compressed 10271723 10994978 0.93

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Vortex (geomean): 1.018x ➖
Parquet (geomean): 1.013x ➖
Shifts: Parquet (control) +1.3% · Median polish +1.6%


datafusion / vortex-file-compressed (1.059x ➖, 0↑ 3↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 5083752 4384828 1.16
fineweb_q01/datafusion:vortex-file-compressed 26662725 24627028 1.08
fineweb_q02/datafusion:vortex-file-compressed 🚨 30518109 26526662 1.15
fineweb_q03/datafusion:vortex-file-compressed 78813664 83760660 0.94
fineweb_q04/datafusion:vortex-file-compressed 266405296 262533216 1.01
fineweb_q05/datafusion:vortex-file-compressed 228975272 231457740 0.99
fineweb_q06/datafusion:vortex-file-compressed 68781480 62774841 1.10
fineweb_q07/datafusion:vortex-file-compressed 68643654 70450129 0.97
fineweb_q08/datafusion:vortex-file-compressed 🚨 28098783 24453372 1.15
datafusion / vortex-compact (1.020x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 4873232 4773811 1.02
fineweb_q01/datafusion:vortex-compact 161761040 160314361 1.01
fineweb_q02/datafusion:vortex-compact 165642093 161367957 1.03
fineweb_q03/datafusion:vortex-compact 1440374915 1430877487 1.01
fineweb_q04/datafusion:vortex-compact 1578719357 1561964291 1.01
fineweb_q05/datafusion:vortex-compact 1227277671 1230853078 1.00
fineweb_q06/datafusion:vortex-compact 702213716 689921829 1.02
fineweb_q07/datafusion:vortex-compact 742263030 731742287 1.01
fineweb_q08/datafusion:vortex-compact 22741767 21122636 1.08
datafusion / parquet (1.023x ➖, 0↑ 1↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 6909179 6195522 1.12
fineweb_q01/datafusion:parquet 278726101 281458697 0.99
fineweb_q02/datafusion:parquet 281303826 283543346 0.99
fineweb_q03/datafusion:parquet 287524721 274293121 1.05
fineweb_q04/datafusion:parquet 297097631 289831020 1.03
fineweb_q05/datafusion:parquet 294031142 287761091 1.02
fineweb_q06/datafusion:parquet 282719244 291079226 0.97
fineweb_q07/datafusion:parquet 284065716 275259619 1.03
fineweb_q08/datafusion:parquet 278805406 274157694 1.02
duckdb / vortex-file-compressed (0.993x ➖, 1↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3212852 3349546 0.96
fineweb_q01/duckdb:vortex-file-compressed 28041319 26242843 1.07
fineweb_q02/duckdb:vortex-file-compressed 27382406 25327173 1.08
fineweb_q03/duckdb:vortex-file-compressed 🚀 131466941 168768191 0.78
fineweb_q04/duckdb:vortex-file-compressed 241870849 236216543 1.02
fineweb_q05/duckdb:vortex-file-compressed 222025405 219049386 1.01
fineweb_q06/duckdb:vortex-file-compressed 65848267 64582048 1.02
fineweb_q07/duckdb:vortex-file-compressed 67216950 67712594 0.99
fineweb_q08/duckdb:vortex-file-compressed 25208106 24399729 1.03
duckdb / vortex-compact (1.002x ➖, 0↑ 1↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4045198 4179478 0.97
fineweb_q01/duckdb:vortex-compact 🚨 110828571 98631024 1.12
fineweb_q02/duckdb:vortex-compact 112980195 113586152 0.99
fineweb_q03/duckdb:vortex-compact 860640566 869385029 0.99
fineweb_q04/duckdb:vortex-compact 908616305 901122040 1.01
fineweb_q05/duckdb:vortex-compact 811871001 811491343 1.00
fineweb_q06/duckdb:vortex-compact 466352106 471139791 0.99
fineweb_q07/duckdb:vortex-compact 470936794 480988002 0.98
fineweb_q08/duckdb:vortex-compact 21812685 22467055 0.97
duckdb / parquet (1.003x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 36464467 36122788 1.01
fineweb_q01/duckdb:parquet 93152448 92804561 1.00
fineweb_q02/duckdb:parquet 95560456 97414500 0.98
fineweb_q03/duckdb:parquet 307471207 305471839 1.01
fineweb_q04/duckdb:parquet 437840921 437638544 1.00
fineweb_q05/duckdb:parquet 408251201 408233543 1.00
fineweb_q06/duckdb:parquet 198273601 197132429 1.01
fineweb_q07/duckdb:parquet 209153315 207722391 1.01
fineweb_q08/duckdb:parquet 57868907 57292706 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +2.1% +6.1% -3.8% +35.3% ➖ noise
0 datafusion:vortex-file-compressed +15.9% +6.1% +9.3% +75.9% ➖ noise
0 duckdb:vortex-compact -3.2% +6.1% -8.8% +32.2% ➖ noise
0 duckdb:vortex-file-compressed -4.1% +6.1% -9.6% +47.1% ➖ noise
1 datafusion:vortex-compact +0.9% -0.3% +1.2% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +8.3% -0.3% +8.6% +20.6% ➖ noise
1 duckdb:vortex-compact +12.4% -0.3% +12.7% +21.4% ➖ noise
1 duckdb:vortex-file-compressed +6.9% -0.3% +7.2% +45.3% ➖ noise
2 datafusion:vortex-compact +2.6% -1.3% +4.1% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +15.0% -1.3% +16.6% +20.0% ➖ noise
2 duckdb:vortex-compact -0.5% -1.3% +0.8% +15.7% ➖ noise
2 duckdb:vortex-file-compressed +8.1% -1.3% +9.6% +11.3% ➖ noise
3 datafusion:vortex-compact +0.7% +2.7% -2.0% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -5.9% +2.7% -8.4% +14.5% ➖ noise
3 duckdb:vortex-compact -1.0% +2.7% -3.6% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -22.1% +2.7% -24.2% +32.3% ➖ noise
4 datafusion:vortex-compact +1.1% +1.3% -0.2% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +1.5% +1.3% +0.2% +10.0% ➖ noise
4 duckdb:vortex-compact +0.8% +1.3% -0.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +2.4% +1.3% +1.1% +10.0% ➖ noise
5 datafusion:vortex-compact -0.3% +1.1% -1.4% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.1% +1.1% -2.1% +10.0% ➖ noise
5 duckdb:vortex-compact +0.0% +1.1% -1.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.4% +1.1% +0.3% +10.0% ➖ noise
6 datafusion:vortex-compact +1.8% -1.2% +3.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +9.6% -1.2% +10.9% +18.4% ➖ noise
6 duckdb:vortex-compact -1.0% -1.2% +0.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +2.0% -1.2% +3.2% +10.3% ➖ noise
7 datafusion:vortex-compact +1.4% +1.9% -0.5% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -2.6% +1.9% -4.4% +13.4% ➖ noise
7 duckdb:vortex-compact -2.1% +1.9% -3.9% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.7% +1.9% -2.6% +10.0% ➖ noise
8 datafusion:vortex-compact +7.7% +1.3% +6.2% +23.9% ➖ noise
8 datafusion:vortex-file-compressed +14.9% +1.3% +13.4% +22.1% ➖ noise
8 duckdb:vortex-compact -2.9% +1.3% -4.2% +19.2% ➖ noise
8 duckdb:vortex-file-compressed +3.3% +1.3% +1.9% +13.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Vortex (geomean): 0.998x ➖
Parquet (geomean): 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.1%


datafusion / vortex-file-compressed (0.999x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 27550595 28033608 0.98
tpcds_q02/datafusion:vortex-file-compressed 52695925 52580801 1.00
tpcds_q03/datafusion:vortex-file-compressed 19962631 19915497 1.00
tpcds_q04/datafusion:vortex-file-compressed 288921185 284995075 1.01
tpcds_q05/datafusion:vortex-file-compressed 55648208 53271389 1.04
tpcds_q06/datafusion:vortex-file-compressed 49881403 49215379 1.01
tpcds_q07/datafusion:vortex-file-compressed 51451818 49994931 1.03
tpcds_q08/datafusion:vortex-file-compressed 37626346 36928877 1.02
tpcds_q09/datafusion:vortex-file-compressed 50671125 49647195 1.02
tpcds_q10/datafusion:vortex-file-compressed 45342034 42766805 1.06
tpcds_q11/datafusion:vortex-file-compressed 167358996 160785247 1.04
tpcds_q12/datafusion:vortex-file-compressed 21927933 23160678 0.95
tpcds_q13/datafusion:vortex-file-compressed 52678624 53410674 0.99
tpcds_q14/datafusion:vortex-file-compressed 200396153 198014351 1.01
tpcds_q15/datafusion:vortex-file-compressed 33650990 34154013 0.99
tpcds_q16/datafusion:vortex-file-compressed 27683238 28492672 0.97
tpcds_q17/datafusion:vortex-file-compressed 65239270 65784138 0.99
tpcds_q18/datafusion:vortex-file-compressed 74511760 76824287 0.97
tpcds_q19/datafusion:vortex-file-compressed 29564027 29750905 0.99
tpcds_q20/datafusion:vortex-file-compressed 24960693 25529849 0.98
tpcds_q21/datafusion:vortex-file-compressed 142569048 136477523 1.04
tpcds_q22/datafusion:vortex-file-compressed 59187081 58896669 1.00
tpcds_q23/datafusion:vortex-file-compressed 145397653 144162639 1.01
tpcds_q24/datafusion:vortex-file-compressed 108261989 111597300 0.97
tpcds_q25/datafusion:vortex-file-compressed 65833875 64908199 1.01
tpcds_q26/datafusion:vortex-file-compressed 36294791 35881460 1.01
tpcds_q27/datafusion:vortex-file-compressed 116705853 117412603 0.99
tpcds_q28/datafusion:vortex-file-compressed 43211619 43636597 0.99
tpcds_q29/datafusion:vortex-file-compressed 66156240 64785413 1.02
tpcds_q30/datafusion:vortex-file-compressed 30289250 30417525 1.00
tpcds_q31/datafusion:vortex-file-compressed 91457789 93460302 0.98
tpcds_q32/datafusion:vortex-file-compressed 22201378 20202001 1.10
tpcds_q33/datafusion:vortex-file-compressed 38211475 37652301 1.01
tpcds_q34/datafusion:vortex-file-compressed 31698343 30836570 1.03
tpcds_q35/datafusion:vortex-file-compressed 53337489 53920509 0.99
tpcds_q36/datafusion:vortex-file-compressed 74528272 74016872 1.01
tpcds_q37/datafusion:vortex-file-compressed 33648709 32951126 1.02
tpcds_q38/datafusion:vortex-file-compressed 50899338 52045064 0.98
tpcds_q39/datafusion:vortex-file-compressed 138064501 151152397 0.91
tpcds_q40/datafusion:vortex-file-compressed 53332704 52195685 1.02
tpcds_q41/datafusion:vortex-file-compressed 17246301 16811115 1.03
tpcds_q42/datafusion:vortex-file-compressed 17737084 17578936 1.01
tpcds_q43/datafusion:vortex-file-compressed 31217925 31768529 0.98
tpcds_q44/datafusion:vortex-file-compressed 41885047 41713176 1.00
tpcds_q45/datafusion:vortex-file-compressed 34366969 33998383 1.01
tpcds_q46/datafusion:vortex-file-compressed 46016388 46533896 0.99
tpcds_q47/datafusion:vortex-file-compressed 204548880 200753843 1.02
tpcds_q48/datafusion:vortex-file-compressed 41857840 41444274 1.01
tpcds_q49/datafusion:vortex-file-compressed 64410727 68056863 0.95
tpcds_q50/datafusion:vortex-file-compressed 45140705 45514437 0.99
tpcds_q51/datafusion:vortex-file-compressed 88912145 89555802 0.99
tpcds_q52/datafusion:vortex-file-compressed 17750736 19138653 0.93
tpcds_q53/datafusion:vortex-file-compressed 25534463 24699430 1.03
tpcds_q54/datafusion:vortex-file-compressed 43474048 44189246 0.98
tpcds_q55/datafusion:vortex-file-compressed 17836609 17846580 1.00
tpcds_q56/datafusion:vortex-file-compressed 39701082 38503989 1.03
tpcds_q57/datafusion:vortex-file-compressed 122839658 125626689 0.98
tpcds_q58/datafusion:vortex-file-compressed 69406822 69888435 0.99
tpcds_q59/datafusion:vortex-file-compressed 72255298 70064396 1.03
tpcds_q60/datafusion:vortex-file-compressed 39505288 41499953 0.95
tpcds_q61/datafusion:vortex-file-compressed 49465978 49846294 0.99
tpcds_q62/datafusion:vortex-file-compressed 31215219 31005596 1.01
tpcds_q63/datafusion:vortex-file-compressed 24700820 25370305 0.97
tpcds_q64/datafusion:vortex-file-compressed 463389110 462420511 1.00
tpcds_q65/datafusion:vortex-file-compressed 46269549 47312578 0.98
tpcds_q66/datafusion:vortex-file-compressed 92851180 90853632 1.02
tpcds_q67/datafusion:vortex-file-compressed 115417353 115854124 1.00
tpcds_q68/datafusion:vortex-file-compressed 45221169 44024595 1.03
tpcds_q69/datafusion:vortex-file-compressed 40930720 41230418 0.99
tpcds_q70/datafusion:vortex-file-compressed 111381737 110003112 1.01
tpcds_q71/datafusion:vortex-file-compressed 29722288 32232228 0.92
tpcds_q72/datafusion:vortex-file-compressed 2573566399 2556611392 1.01
tpcds_q73/datafusion:vortex-file-compressed 33004200 33406912 0.99
tpcds_q74/datafusion:vortex-file-compressed 114718845 115788285 0.99
tpcds_q75/datafusion:vortex-file-compressed 116254050 118215981 0.98
tpcds_q76/datafusion:vortex-file-compressed 32344995 33309560 0.97
tpcds_q77/datafusion:vortex-file-compressed 50157984 50352825 1.00
tpcds_q78/datafusion:vortex-file-compressed 122942011 120395348 1.02
tpcds_q79/datafusion:vortex-file-compressed 37680380 36636790 1.03
tpcds_q80/datafusion:vortex-file-compressed 112832038 112742885 1.00
tpcds_q81/datafusion:vortex-file-compressed 34184469 35996706 0.95
tpcds_q82/datafusion:vortex-file-compressed 35311022 35082787 1.01
tpcds_q83/datafusion:vortex-file-compressed 51717614 50243262 1.03
tpcds_q84/datafusion:vortex-file-compressed 14714554 15478640 0.95
tpcds_q85/datafusion:vortex-file-compressed 99621224 99748521 1.00
tpcds_q86/datafusion:vortex-file-compressed 18650923 19014637 0.98
tpcds_q87/datafusion:vortex-file-compressed 52172590 50878127 1.03
tpcds_q88/datafusion:vortex-file-compressed 72450631 72421117 1.00
tpcds_q89/datafusion:vortex-file-compressed 34695779 35957215 0.96
tpcds_q90/datafusion:vortex-file-compressed 17522512 17618926 0.99
tpcds_q91/datafusion:vortex-file-compressed 25216457 24819953 1.02
tpcds_q92/datafusion:vortex-file-compressed 18248180 17975600 1.02
tpcds_q93/datafusion:vortex-file-compressed 33685845 32945290 1.02
tpcds_q94/datafusion:vortex-file-compressed 23627370 24540915 0.96
tpcds_q95/datafusion:vortex-file-compressed 60006948 58607416 1.02
tpcds_q96/datafusion:vortex-file-compressed 15528164 15123575 1.03
tpcds_q97/datafusion:vortex-file-compressed 29678435 29478021 1.01
tpcds_q98/datafusion:vortex-file-compressed 31886121 31943357 1.00
tpcds_q99/datafusion:vortex-file-compressed 44874059 45173254 0.99
datafusion / vortex-compact (1.001x ➖, 0↑ 2↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 35782978 33413703 1.07
tpcds_q02/datafusion:vortex-compact 58219639 58753898 0.99
tpcds_q03/datafusion:vortex-compact 26414591 26060335 1.01
tpcds_q04/datafusion:vortex-compact 327229336 329564920 0.99
tpcds_q05/datafusion:vortex-compact 64925572 62898494 1.03
tpcds_q06/datafusion:vortex-compact 57090745 58564719 0.97
tpcds_q07/datafusion:vortex-compact 65387846 67514309 0.97
tpcds_q08/datafusion:vortex-compact 45188752 45689248 0.99
tpcds_q09/datafusion:vortex-compact 69117944 70063956 0.99
tpcds_q10/datafusion:vortex-compact 65773649 64238777 1.02
tpcds_q11/datafusion:vortex-compact 187917128 188654641 1.00
tpcds_q12/datafusion:vortex-compact 27365699 27316525 1.00
tpcds_q13/datafusion:vortex-compact 112761343 111817872 1.01
tpcds_q14/datafusion:vortex-compact 253284274 251362607 1.01
tpcds_q15/datafusion:vortex-compact 🚨 40931369 37173887 1.10
tpcds_q16/datafusion:vortex-compact 38288160 37975522 1.01
tpcds_q17/datafusion:vortex-compact 92159484 93711328 0.98
tpcds_q18/datafusion:vortex-compact 88339965 87330092 1.01
tpcds_q19/datafusion:vortex-compact 44922513 45341451 0.99
tpcds_q20/datafusion:vortex-compact 29319918 29207581 1.00
tpcds_q21/datafusion:vortex-compact 141002210 144678479 0.97
tpcds_q22/datafusion:vortex-compact 67044734 65981116 1.02
tpcds_q23/datafusion:vortex-compact 180549991 183526389 0.98
tpcds_q24/datafusion:vortex-compact 141349366 142610978 0.99
tpcds_q25/datafusion:vortex-compact 95744269 95214976 1.01
tpcds_q26/datafusion:vortex-compact 46242717 46606324 0.99
tpcds_q27/datafusion:vortex-compact 157497727 160714724 0.98
tpcds_q28/datafusion:vortex-compact 82990584 82370639 1.01
tpcds_q29/datafusion:vortex-compact 93264238 93523483 1.00
tpcds_q30/datafusion:vortex-compact 34046528 36105991 0.94
tpcds_q31/datafusion:vortex-compact 131210759 130211025 1.01
tpcds_q32/datafusion:vortex-compact 26214953 26664928 0.98
tpcds_q33/datafusion:vortex-compact 55051180 54465697 1.01
tpcds_q34/datafusion:vortex-compact 50956904 51605462 0.99
tpcds_q35/datafusion:vortex-compact 69610803 69366798 1.00
tpcds_q36/datafusion:vortex-compact 99593612 97360131 1.02
tpcds_q37/datafusion:vortex-compact 46595871 46450735 1.00
tpcds_q38/datafusion:vortex-compact 69670820 67929174 1.03
tpcds_q39/datafusion:vortex-compact 146614550 150026528 0.98
tpcds_q40/datafusion:vortex-compact 58467911 58493201 1.00
tpcds_q41/datafusion:vortex-compact 19214752 19191556 1.00
tpcds_q42/datafusion:vortex-compact 24538967 23554534 1.04
tpcds_q43/datafusion:vortex-compact 38092382 37431941 1.02
tpcds_q44/datafusion:vortex-compact 70002304 71910964 0.97
tpcds_q45/datafusion:vortex-compact 38523097 39205261 0.98
tpcds_q46/datafusion:vortex-compact 72937841 71674288 1.02
tpcds_q47/datafusion:vortex-compact 226011179 224061170 1.01
tpcds_q48/datafusion:vortex-compact 78270142 86093245 0.91
tpcds_q49/datafusion:vortex-compact 88891359 89657769 0.99
tpcds_q50/datafusion:vortex-compact 63735075 64099585 0.99
tpcds_q51/datafusion:vortex-compact 98981365 96926374 1.02
tpcds_q52/datafusion:vortex-compact 24372927 24040125 1.01
tpcds_q53/datafusion:vortex-compact 34752548 35931932 0.97
tpcds_q54/datafusion:vortex-compact 61818272 59919510 1.03
tpcds_q55/datafusion:vortex-compact 24765682 25007343 0.99
tpcds_q56/datafusion:vortex-compact 56377636 56723827 0.99
tpcds_q57/datafusion:vortex-compact 138112631 139600870 0.99
tpcds_q58/datafusion:vortex-compact 77564540 80175124 0.97
tpcds_q59/datafusion:vortex-compact 83429319 84482651 0.99
tpcds_q60/datafusion:vortex-compact 55769547 56808974 0.98
tpcds_q61/datafusion:vortex-compact 74740878 78382544 0.95
tpcds_q62/datafusion:vortex-compact 33839341 33556128 1.01
tpcds_q63/datafusion:vortex-compact 35328264 35937271 0.98
tpcds_q64/datafusion:vortex-compact 546714568 540391075 1.01
tpcds_q65/datafusion:vortex-compact 70429322 70033759 1.01
tpcds_q66/datafusion:vortex-compact 95563991 96375653 0.99
tpcds_q67/datafusion:vortex-compact 131422239 127149385 1.03
tpcds_q68/datafusion:vortex-compact 70956380 71005258 1.00
tpcds_q69/datafusion:vortex-compact 61387526 62939485 0.98
tpcds_q70/datafusion:vortex-compact 124548195 127030281 0.98
tpcds_q71/datafusion:vortex-compact 46932095 46320578 1.01
tpcds_q72/datafusion:vortex-compact 2609063538 2605955290 1.00
tpcds_q73/datafusion:vortex-compact 54912938 52657350 1.04
tpcds_q74/datafusion:vortex-compact 135691836 135053396 1.00
tpcds_q75/datafusion:vortex-compact 156851924 163711632 0.96
tpcds_q76/datafusion:vortex-compact 50531482 49259054 1.03
tpcds_q77/datafusion:vortex-compact 65497486 65470295 1.00
tpcds_q78/datafusion:vortex-compact 147542107 150734544 0.98
tpcds_q79/datafusion:vortex-compact 63957370 63268445 1.01
tpcds_q80/datafusion:vortex-compact 131285233 130085602 1.01
tpcds_q81/datafusion:vortex-compact 🚨 44455585 40320302 1.10
tpcds_q82/datafusion:vortex-compact 48668032 49281949 0.99
tpcds_q83/datafusion:vortex-compact 57634344 57137210 1.01
tpcds_q84/datafusion:vortex-compact 18479878 18105159 1.02
tpcds_q85/datafusion:vortex-compact 123462105 127369935 0.97
tpcds_q86/datafusion:vortex-compact 22502235 22253513 1.01
tpcds_q87/datafusion:vortex-compact 68765684 67825650 1.01
tpcds_q88/datafusion:vortex-compact 122011931 122083306 1.00
tpcds_q89/datafusion:vortex-compact 45485879 46093192 0.99
tpcds_q90/datafusion:vortex-compact 24282975 23750057 1.02
tpcds_q91/datafusion:vortex-compact 40064328 39672085 1.01
tpcds_q92/datafusion:vortex-compact 25997699 25448809 1.02
tpcds_q93/datafusion:vortex-compact 46227619 46404531 1.00
tpcds_q94/datafusion:vortex-compact 30587768 30811777 0.99
tpcds_q95/datafusion:vortex-compact 72033406 68769726 1.05
tpcds_q96/datafusion:vortex-compact 24165118 25206076 0.96
tpcds_q97/datafusion:vortex-compact 43485230 42487619 1.02
tpcds_q98/datafusion:vortex-compact 37770463 38134473 0.99
tpcds_q99/datafusion:vortex-compact 50136204 49517922 1.01
datafusion / parquet (1.000x ➖, 1↑ 1↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 37074850 36817969 1.01
tpcds_q02/datafusion:parquet 46092534 45369255 1.02
tpcds_q03/datafusion:parquet 15720986 15721799 1.00
tpcds_q04/datafusion:parquet 311231655 323278954 0.96
tpcds_q05/datafusion:parquet 50006165 50529485 0.99
tpcds_q06/datafusion:parquet 64755897 67620967 0.96
tpcds_q07/datafusion:parquet 88156247 87882156 1.00
tpcds_q08/datafusion:parquet 31951251 31353134 1.02
tpcds_q09/datafusion:parquet 56817797 55230139 1.03
tpcds_q10/datafusion:parquet 82781751 82215980 1.01
tpcds_q11/datafusion:parquet 184548950 180627479 1.02
tpcds_q12/datafusion:parquet 24155668 24124143 1.00
tpcds_q13/datafusion:parquet 86079174 86979846 0.99
tpcds_q14/datafusion:parquet 190755839 195712724 0.97
tpcds_q15/datafusion:parquet 26613091 26171747 1.02
tpcds_q16/datafusion:parquet 26907152 27865345 0.97
tpcds_q17/datafusion:parquet 70624063 68089898 1.04
tpcds_q18/datafusion:parquet 129869199 131357294 0.99
tpcds_q19/datafusion:parquet 27285273 28203838 0.97
tpcds_q20/datafusion:parquet 20940290 21238215 0.99
tpcds_q21/datafusion:parquet 21508222 21592431 1.00
tpcds_q22/datafusion:parquet 🚨 165611508 128098148 1.29
tpcds_q23/datafusion:parquet 163133734 160424139 1.02
tpcds_q24/datafusion:parquet 103163950 108976775 0.95
tpcds_q25/datafusion:parquet 69974134 70893525 0.99
tpcds_q26/datafusion:parquet 74096681 75388031 0.98
tpcds_q27/datafusion:parquet 161356729 161476657 1.00
tpcds_q28/datafusion:parquet 47592571 48542029 0.98
tpcds_q29/datafusion:parquet 70956398 72456368 0.98
tpcds_q30/datafusion:parquet 43654821 43756522 1.00
tpcds_q31/datafusion:parquet 76199185 73665692 1.03
tpcds_q32/datafusion:parquet 22434371 22862170 0.98
tpcds_q33/datafusion:parquet 35420397 34663614 1.02
tpcds_q34/datafusion:parquet 27380853 27044621 1.01
tpcds_q35/datafusion:parquet 84902682 86085937 0.99
tpcds_q36/datafusion:parquet 64600717 64129019 1.01
tpcds_q37/datafusion:parquet 23375438 24515144 0.95
tpcds_q38/datafusion:parquet 52328990 50291522 1.04
tpcds_q39/datafusion:parquet 81732465 82121106 1.00
tpcds_q40/datafusion:parquet 28499883 27873567 1.02
tpcds_q41/datafusion:parquet 15590640 15606569 1.00
tpcds_q42/datafusion:parquet 14494921 13589154 1.07
tpcds_q43/datafusion:parquet 19502829 18802522 1.04
tpcds_q44/datafusion:parquet 41970271 42033734 1.00
tpcds_q45/datafusion:parquet 32705673 31946188 1.02
tpcds_q46/datafusion:parquet 38437023 39012225 0.99
tpcds_q47/datafusion:parquet 134147117 132898517 1.01
tpcds_q48/datafusion:parquet 77904977 81697935 0.95
tpcds_q49/datafusion:parquet 63717467 65473284 0.97
tpcds_q50/datafusion:parquet 48902550 47788703 1.02
tpcds_q51/datafusion:parquet 88148174 88540568 1.00
tpcds_q52/datafusion:parquet 14745585 13864313 1.06
tpcds_q53/datafusion:parquet 21138915 23379328 0.90
tpcds_q54/datafusion:parquet 42959490 42106594 1.02
tpcds_q55/datafusion:parquet 13558586 14139325 0.96
tpcds_q56/datafusion:parquet 36819132 34871612 1.06
tpcds_q57/datafusion:parquet 105272244 105650945 1.00
tpcds_q58/datafusion:parquet 58356180 58295046 1.00
tpcds_q59/datafusion:parquet 59448547 59567193 1.00
tpcds_q60/datafusion:parquet 34626903 34714200 1.00
tpcds_q61/datafusion:parquet 51269962 50919264 1.01
tpcds_q62/datafusion:parquet 🚀 24847497 28879215 0.86
tpcds_q63/datafusion:parquet 21686413 22222979 0.98
tpcds_q64/datafusion:parquet 548707966 550877595 1.00
tpcds_q65/datafusion:parquet 44029497 45069119 0.98
tpcds_q66/datafusion:parquet 77993811 76685174 1.02
tpcds_q67/datafusion:parquet 147247704 153701342 0.96
tpcds_q68/datafusion:parquet 38868986 40067510 0.97
tpcds_q69/datafusion:parquet 77430526 76988181 1.01
tpcds_q70/datafusion:parquet 96135424 92049235 1.04
tpcds_q71/datafusion:parquet 26150025 26225366 1.00
tpcds_q72/datafusion:parquet 637639390 629113415 1.01
tpcds_q73/datafusion:parquet 26018689 27115398 0.96
tpcds_q74/datafusion:parquet 102013965 101818635 1.00
tpcds_q75/datafusion:parquet 117013190 115995719 1.01
tpcds_q76/datafusion:parquet 36391636 37237236 0.98
tpcds_q77/datafusion:parquet 48402499 47785944 1.01
tpcds_q78/datafusion:parquet 122203916 120333638 1.02
tpcds_q79/datafusion:parquet 31066470 30486532 1.02
tpcds_q80/datafusion:parquet 93826449 93693067 1.00
tpcds_q81/datafusion:parquet 40626449 40952056 0.99
tpcds_q82/datafusion:parquet 23477367 23576079 1.00
tpcds_q83/datafusion:parquet 48920982 47303326 1.03
tpcds_q84/datafusion:parquet 48123569 46597615 1.03
tpcds_q85/datafusion:parquet 169499602 168024282 1.01
tpcds_q86/datafusion:parquet 18455130 17840907 1.03
tpcds_q87/datafusion:parquet 50732290 49883167 1.02
tpcds_q88/datafusion:parquet 69920424 69204400 1.01
tpcds_q89/datafusion:parquet 23989092 23488970 1.02
tpcds_q90/datafusion:parquet 18451976 18668283 0.99
tpcds_q91/datafusion:parquet 67515383 69464045 0.97
tpcds_q92/datafusion:parquet 22692554 21958471 1.03
tpcds_q93/datafusion:parquet 34508105 33679562 1.02
tpcds_q94/datafusion:parquet 24121339 24454413 0.99
tpcds_q95/datafusion:parquet 67994509 67556512 1.01
tpcds_q96/datafusion:parquet 14048388 15429190 0.91
tpcds_q97/datafusion:parquet 32763375 32407810 1.01
tpcds_q98/datafusion:parquet 25524344 25670684 0.99
tpcds_q99/datafusion:parquet 27530921 27690215 0.99
duckdb / vortex-file-compressed (0.992x ➖, 4↑ 1↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 24983106 26278702 0.95
tpcds_q02/duckdb:vortex-file-compressed 80253750 83757454 0.96
tpcds_q03/duckdb:vortex-file-compressed 23628995 23447186 1.01
tpcds_q04/duckdb:vortex-file-compressed 103290808 100212349 1.03
tpcds_q05/duckdb:vortex-file-compressed 96630386 92551965 1.04
tpcds_q06/duckdb:vortex-file-compressed 34569926 34495496 1.00
tpcds_q07/duckdb:vortex-file-compressed 23330206 23105121 1.01
tpcds_q08/duckdb:vortex-file-compressed 27211628 27757981 0.98
tpcds_q09/duckdb:vortex-file-compressed 32836012 32701956 1.00
tpcds_q10/duckdb:vortex-file-compressed 41749272 41535044 1.01
tpcds_q11/duckdb:vortex-file-compressed 59512737 59101966 1.01
tpcds_q12/duckdb:vortex-file-compressed 13896679 13913124 1.00
tpcds_q13/duckdb:vortex-file-compressed 41685187 40375780 1.03
tpcds_q14/duckdb:vortex-file-compressed 182122170 191412133 0.95
tpcds_q15/duckdb:vortex-file-compressed 40332796 40389024 1.00
tpcds_q16/duckdb:vortex-file-compressed 29463693 28694298 1.03
tpcds_q17/duckdb:vortex-file-compressed 36517850 37089972 0.98
tpcds_q18/duckdb:vortex-file-compressed 43446909 44810659 0.97
tpcds_q19/duckdb:vortex-file-compressed 32743606 32438886 1.01
tpcds_q20/duckdb:vortex-file-compressed 15321539 16097667 0.95
tpcds_q21/duckdb:vortex-file-compressed 20517850 20568617 1.00
tpcds_q22/duckdb:vortex-file-compressed 101909399 103368343 0.99
tpcds_q23/duckdb:vortex-file-compressed 143384596 147994148 0.97
tpcds_q24/duckdb:vortex-file-compressed 54377369 55948294 0.97
tpcds_q25/duckdb:vortex-file-compressed 35999471 37184043 0.97
tpcds_q26/duckdb:vortex-file-compressed 39890882 38327855 1.04
tpcds_q27/duckdb:vortex-file-compressed 84425342 84195863 1.00
tpcds_q28/duckdb:vortex-file-compressed 34053328 34342731 0.99
tpcds_q29/duckdb:vortex-file-compressed 35316030 33861279 1.04
tpcds_q30/duckdb:vortex-file-compressed 29955064 28758934 1.04
tpcds_q31/duckdb:vortex-file-compressed 28859979 28575487 1.01
tpcds_q32/duckdb:vortex-file-compressed 16104551 17031540 0.95
tpcds_q33/duckdb:vortex-file-compressed 61063236 60215640 1.01
tpcds_q34/duckdb:vortex-file-compressed 19320260 19322683 1.00
tpcds_q35/duckdb:vortex-file-compressed 73117099 67272126 1.09
tpcds_q36/duckdb:vortex-file-compressed 26990730 27588325 0.98
tpcds_q37/duckdb:vortex-file-compressed 21768018 21618923 1.01
tpcds_q38/duckdb:vortex-file-compressed 40326338 40566621 0.99
tpcds_q39/duckdb:vortex-file-compressed 43758638 44328517 0.99
tpcds_q40/duckdb:vortex-file-compressed 24015830 24387976 0.98
tpcds_q41/duckdb:vortex-file-compressed 12818890 12968439 0.99
tpcds_q42/duckdb:vortex-file-compressed 11728025 11999852 0.98
tpcds_q43/duckdb:vortex-file-compressed 31175673 31333447 0.99
tpcds_q44/duckdb:vortex-file-compressed 23826600 24576373 0.97
tpcds_q45/duckdb:vortex-file-compressed 26662847 27773048 0.96
tpcds_q46/duckdb:vortex-file-compressed 46482749 46129778 1.01
tpcds_q47/duckdb:vortex-file-compressed 49905366 50880025 0.98
tpcds_q48/duckdb:vortex-file-compressed 38811956 37431254 1.04
tpcds_q49/duckdb:vortex-file-compressed 28938795 29068999 1.00
tpcds_q50/duckdb:vortex-file-compressed 33009049 33278710 0.99
tpcds_q51/duckdb:vortex-file-compressed 101372421 102562784 0.99
tpcds_q52/duckdb:vortex-file-compressed 12580538 13012865 0.97
tpcds_q53/duckdb:vortex-file-compressed 17561883 17226241 1.02
tpcds_q54/duckdb:vortex-file-compressed 45280819 43979540 1.03
tpcds_q55/duckdb:vortex-file-compressed 11394113 11238595 1.01
tpcds_q56/duckdb:vortex-file-compressed 62132070 59639193 1.04
tpcds_q57/duckdb:vortex-file-compressed 44959004 45662520 0.98
tpcds_q58/duckdb:vortex-file-compressed 32245680 34753425 0.93
tpcds_q59/duckdb:vortex-file-compressed 79768209 80337199 0.99
tpcds_q60/duckdb:vortex-file-compressed 68599346 65827398 1.04
tpcds_q61/duckdb:vortex-file-compressed 37320782 39143329 0.95
tpcds_q62/duckdb:vortex-file-compressed 🚀 16741701 20944725 0.80
tpcds_q63/duckdb:vortex-file-compressed 17583974 17052395 1.03
tpcds_q64/duckdb:vortex-file-compressed 78337019 79143642 0.99
tpcds_q65/duckdb:vortex-file-compressed 23804565 23000440 1.03
tpcds_q66/duckdb:vortex-file-compressed 56189608 57477357 0.98
tpcds_q67/duckdb:vortex-file-compressed 140005242 142940269 0.98
tpcds_q68/duckdb:vortex-file-compressed 40400316 39148192 1.03
tpcds_q69/duckdb:vortex-file-compressed 42859682 44239884 0.97
tpcds_q70/duckdb:vortex-file-compressed 28540711 27604483 1.03
tpcds_q71/duckdb:vortex-file-compressed 20683266 21255472 0.97
tpcds_q72/duckdb:vortex-file-compressed 174664625 175288130 1.00
tpcds_q73/duckdb:vortex-file-compressed 19643623 19464944 1.01
tpcds_q74/duckdb:vortex-file-compressed 46284619 45889277 1.01
tpcds_q75/duckdb:vortex-file-compressed 58635853 61045015 0.96
tpcds_q76/duckdb:vortex-file-compressed 🚀 60022550 69744733 0.86
tpcds_q77/duckdb:vortex-file-compressed 61664096 60528409 1.02
tpcds_q78/duckdb:vortex-file-compressed 81050403 79131933 1.02
tpcds_q79/duckdb:vortex-file-compressed 35283300 35429995 1.00
tpcds_q80/duckdb:vortex-file-compressed 89183315 87175862 1.02
tpcds_q81/duckdb:vortex-file-compressed 34125503 34272604 1.00
tpcds_q82/duckdb:vortex-file-compressed 21363162 22369253 0.96
tpcds_q83/duckdb:vortex-file-compressed 27317442 28127852 0.97
tpcds_q84/duckdb:vortex-file-compressed 17877200 17487028 1.02
tpcds_q85/duckdb:vortex-file-compressed 46759985 46968732 1.00
tpcds_q86/duckdb:vortex-file-compressed 16423689 17375275 0.95
tpcds_q87/duckdb:vortex-file-compressed 🚨 46573867 42326566 1.10
tpcds_q88/duckdb:vortex-file-compressed 39967258 40977948 0.98
tpcds_q89/duckdb:vortex-file-compressed 18222256 18643671 0.98
tpcds_q90/duckdb:vortex-file-compressed 13556457 13430483 1.01
tpcds_q91/duckdb:vortex-file-compressed 29231102 29038832 1.01
tpcds_q92/duckdb:vortex-file-compressed 🚀 14238467 15871907 0.90
tpcds_q93/duckdb:vortex-file-compressed 29306654 29865863 0.98
tpcds_q94/duckdb:vortex-file-compressed 22327488 21788113 1.02
tpcds_q95/duckdb:vortex-file-compressed 153526657 145232354 1.06
tpcds_q96/duckdb:vortex-file-compressed 🚀 17038229 19578157 0.87
tpcds_q97/duckdb:vortex-file-compressed 39298991 40009156 0.98
tpcds_q98/duckdb:vortex-file-compressed 18669017 18036394 1.04
tpcds_q99/duckdb:vortex-file-compressed 30288191 31158343 0.97
duckdb / vortex-compact (1.000x ➖, 2↑ 2↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 31929954 33253367 0.96
tpcds_q02/duckdb:vortex-compact 119637905 120791148 0.99
tpcds_q03/duckdb:vortex-compact 49963249 50385474 0.99
tpcds_q04/duckdb:vortex-compact 119376544 120154094 0.99
tpcds_q05/duckdb:vortex-compact 163302358 152194900 1.07
tpcds_q06/duckdb:vortex-compact 40837542 40600306 1.01
tpcds_q07/duckdb:vortex-compact 39659738 37557421 1.06
tpcds_q08/duckdb:vortex-compact 36050493 35253847 1.02
tpcds_q09/duckdb:vortex-compact 58153511 56624612 1.03
tpcds_q10/duckdb:vortex-compact 53695842 53890400 1.00
tpcds_q11/duckdb:vortex-compact 72896929 74642077 0.98
tpcds_q12/duckdb:vortex-compact 20887390 19331614 1.08
tpcds_q13/duckdb:vortex-compact 69523909 67433347 1.03
tpcds_q14/duckdb:vortex-compact 304022620 279868161 1.09
tpcds_q15/duckdb:vortex-compact 44241257 45047235 0.98
tpcds_q16/duckdb:vortex-compact 34181127 33659933 1.02
tpcds_q17/duckdb:vortex-compact 48416853 51587793 0.94
tpcds_q18/duckdb:vortex-compact 57977913 58075497 1.00
tpcds_q19/duckdb:vortex-compact 42524760 41966145 1.01
tpcds_q20/duckdb:vortex-compact 19824028 22013440 0.90
tpcds_q21/duckdb:vortex-compact 27837885 28087954 0.99
tpcds_q22/duckdb:vortex-compact 111408638 110273761 1.01
tpcds_q23/duckdb:vortex-compact 160514237 167544908 0.96
tpcds_q24/duckdb:vortex-compact 75587102 75118724 1.01
tpcds_q25/duckdb:vortex-compact 52233139 50145358 1.04
tpcds_q26/duckdb:vortex-compact 47617621 49633267 0.96
tpcds_q27/duckdb:vortex-compact 140821406 139716684 1.01
tpcds_q28/duckdb:vortex-compact 85038461 84308668 1.01
tpcds_q29/duckdb:vortex-compact 48800395 49075205 0.99
tpcds_q30/duckdb:vortex-compact 36340625 34954293 1.04
tpcds_q31/duckdb:vortex-compact 38367722 39244245 0.98
tpcds_q32/duckdb:vortex-compact 22850236 23332463 0.98
tpcds_q33/duckdb:vortex-compact 132766766 137201141 0.97
tpcds_q34/duckdb:vortex-compact 30876135 30489271 1.01
tpcds_q35/duckdb:vortex-compact 81045520 77520858 1.05
tpcds_q36/duckdb:vortex-compact 35672170 36735797 0.97
tpcds_q37/duckdb:vortex-compact 32119826 31392175 1.02
tpcds_q38/duckdb:vortex-compact 47165366 46557828 1.01
tpcds_q39/duckdb:vortex-compact 52951533 56335849 0.94
tpcds_q40/duckdb:vortex-compact 28817539 27749371 1.04
tpcds_q41/duckdb:vortex-compact 16038339 15767894 1.02
tpcds_q42/duckdb:vortex-compact 16241988 16931932 0.96
tpcds_q43/duckdb:vortex-compact 37694157 38000975 0.99
tpcds_q44/duckdb:vortex-compact 34778575 36030180 0.97
tpcds_q45/duckdb:vortex-compact 33615023 33289668 1.01
tpcds_q46/duckdb:vortex-compact 63017607 61579036 1.02
tpcds_q47/duckdb:vortex-compact 56559412 56676616 1.00
tpcds_q48/duckdb:vortex-compact 56104015 56208920 1.00
tpcds_q49/duckdb:vortex-compact 🚨 45293324 40897684 1.11
tpcds_q50/duckdb:vortex-compact 55928961 56255369 0.99
tpcds_q51/duckdb:vortex-compact 🚀 105993626 129960539 0.82
tpcds_q52/duckdb:vortex-compact 17691165 17059510 1.04
tpcds_q53/duckdb:vortex-compact 24083395 24151325 1.00
tpcds_q54/duckdb:vortex-compact 79186908 77962014 1.02
tpcds_q55/duckdb:vortex-compact 17062004 16835953 1.01
tpcds_q56/duckdb:vortex-compact 132762078 136715106 0.97
tpcds_q57/duckdb:vortex-compact 47419474 47212595 1.00
tpcds_q58/duckdb:vortex-compact 45429833 43633334 1.04
tpcds_q59/duckdb:vortex-compact 102778719 99101265 1.04
tpcds_q60/duckdb:vortex-compact 136115145 140880060 0.97
tpcds_q61/duckdb:vortex-compact 55516541 56246119 0.99
tpcds_q62/duckdb:vortex-compact 🚀 19954032 24396942 0.82
tpcds_q63/duckdb:vortex-compact 24449834 25435182 0.96
tpcds_q64/duckdb:vortex-compact 107147534 105787380 1.01
tpcds_q65/duckdb:vortex-compact 30827635 30587211 1.01
tpcds_q66/duckdb:vortex-compact 88386077 95903314 0.92
tpcds_q67/duckdb:vortex-compact 149723727 147974361 1.01
tpcds_q68/duckdb:vortex-compact 57137477 57872137 0.99
tpcds_q69/duckdb:vortex-compact 53321299 56669238 0.94
tpcds_q70/duckdb:vortex-compact 36752581 36059844 1.02
tpcds_q71/duckdb:vortex-compact 26796013 27200017 0.99
tpcds_q72/duckdb:vortex-compact 196189275 192776869 1.02
tpcds_q73/duckdb:vortex-compact 29666608 30386856 0.98
tpcds_q74/duckdb:vortex-compact 55948375 56028989 1.00
tpcds_q75/duckdb:vortex-compact 69137674 67877391 1.02
tpcds_q76/duckdb:vortex-compact 137737926 140499420 0.98
tpcds_q77/duckdb:vortex-compact 136429406 129136015 1.06
tpcds_q78/duckdb:vortex-compact 87368383 89111152 0.98
tpcds_q79/duckdb:vortex-compact 66012208 64805421 1.02
tpcds_q80/duckdb:vortex-compact 169245025 167355523 1.01
tpcds_q81/duckdb:vortex-compact 39280693 40001528 0.98
tpcds_q82/duckdb:vortex-compact 32502096 32197941 1.01
tpcds_q83/duckdb:vortex-compact 44976140 45123128 1.00
tpcds_q84/duckdb:vortex-compact 22568610 22441859 1.01
tpcds_q85/duckdb:vortex-compact 58195409 61148833 0.95
tpcds_q86/duckdb:vortex-compact 🚨 24407300 20943462 1.17
tpcds_q87/duckdb:vortex-compact 44908377 45579536 0.99
tpcds_q88/duckdb:vortex-compact 45073561 41999361 1.07
tpcds_q89/duckdb:vortex-compact 26230438 26527441 0.99
tpcds_q90/duckdb:vortex-compact 15980602 15998437 1.00
tpcds_q91/duckdb:vortex-compact 46839363 45368068 1.03
tpcds_q92/duckdb:vortex-compact 19675179 20401428 0.96
tpcds_q93/duckdb:vortex-compact 34791184 35180417 0.99
tpcds_q94/duckdb:vortex-compact 25170696 24101951 1.04
tpcds_q95/duckdb:vortex-compact 155242949 155671997 1.00
tpcds_q96/duckdb:vortex-compact 19183489 17857767 1.07
tpcds_q97/duckdb:vortex-compact 41952937 42626443 0.98
tpcds_q98/duckdb:vortex-compact 24521716 24371940 1.01
tpcds_q99/duckdb:vortex-compact 36013298 32850568 1.10
duckdb / parquet (0.997x ➖, 0↑ 1↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 43468190 43812197 0.99
tpcds_q02/duckdb:parquet 61255373 59894276 1.02
tpcds_q03/duckdb:parquet 11552345 11707036 0.99
tpcds_q04/duckdb:parquet 125780292 122792324 1.02
tpcds_q05/duckdb:parquet 70958307 68706775 1.03
tpcds_q06/duckdb:parquet 27737739 28274629 0.98
tpcds_q07/duckdb:parquet 23439705 23232168 1.01
tpcds_q08/duckdb:parquet 29026455 28531974 1.02
tpcds_q09/duckdb:parquet 39718029 39909858 1.00
tpcds_q10/duckdb:parquet 33694198 34282567 0.98
tpcds_q11/duckdb:parquet 89486054 90006066 0.99
tpcds_q12/duckdb:parquet 14522519 14555348 1.00
tpcds_q13/duckdb:parquet 33685086 33818768 1.00
tpcds_q14/duckdb:parquet 164838758 165410505 1.00
tpcds_q15/duckdb:parquet 28001624 29293979 0.96
tpcds_q16/duckdb:parquet 21269885 20890060 1.02
tpcds_q17/duckdb:parquet 37992071 37190904 1.02
tpcds_q18/duckdb:parquet 46301026 45290944 1.02
tpcds_q19/duckdb:parquet 28584492 29248440 0.98
tpcds_q20/duckdb:parquet 15027521 15604191 0.96
tpcds_q21/duckdb:parquet 🚨 12100608 10336267 1.17
tpcds_q22/duckdb:parquet 67621670 65290981 1.04
tpcds_q23/duckdb:parquet 113578072 110641585 1.03
tpcds_q24/duckdb:parquet 45771602 45192955 1.01
tpcds_q25/duckdb:parquet 32907094 32577685 1.01
tpcds_q26/duckdb:parquet 37815044 36234285 1.04
tpcds_q27/duckdb:parquet 88688857 88007670 1.01
tpcds_q28/duckdb:parquet 37173108 36481041 1.02
tpcds_q29/duckdb:parquet 34052109 36063804 0.94
tpcds_q30/duckdb:parquet 38913660 40064365 0.97
tpcds_q31/duckdb:parquet 22667134 22397082 1.01
tpcds_q32/duckdb:parquet 10886306 11648805 0.93
tpcds_q33/duckdb:parquet 73272360 71297736 1.03
tpcds_q34/duckdb:parquet 20897087 20996525 1.00
tpcds_q35/duckdb:parquet 57196254 59686169 0.96
tpcds_q36/duckdb:parquet 20297959 20180570 1.01
tpcds_q37/duckdb:parquet 13713314 13981562 0.98
tpcds_q38/duckdb:parquet 32848187 32432722 1.01
tpcds_q39/duckdb:parquet 31847162 32692302 0.97
tpcds_q40/duckdb:parquet 17453816 16935158 1.03
tpcds_q41/duckdb:parquet 7471922 7162376 1.04
tpcds_q42/duckdb:parquet 9859566 10099733 0.98
tpcds_q43/duckdb:parquet 15304846 15386619 0.99
tpcds_q44/duckdb:parquet 21362170 21727135 0.98
tpcds_q45/duckdb:parquet 25932156 25462437 1.02
tpcds_q46/duckdb:parquet 44461973 45636192 0.97
tpcds_q47/duckdb:parquet 44998785 46266006 0.97
tpcds_q48/duckdb:parquet 30095132 30465569 0.99
tpcds_q49/duckdb:parquet 23448573 24307599 0.96
tpcds_q50/duckdb:parquet 24740441 24584167 1.01
tpcds_q51/duckdb:parquet 94011506 94187250 1.00
tpcds_q52/duckdb:parquet 11227761 10805588 1.04
tpcds_q53/duckdb:parquet 16433032 16375562 1.00
tpcds_q54/duckdb:parquet 42237952 42345695 1.00
tpcds_q55/duckdb:parquet 10670716 10444469 1.02
tpcds_q56/duckdb:parquet 69565001 69087393 1.01
tpcds_q57/duckdb:parquet 34955478 34945227 1.00
tpcds_q58/duckdb:parquet 21480940 20911752 1.03
tpcds_q59/duckdb:parquet 36461425 36306136 1.00
tpcds_q60/duckdb:parquet 71635490 72024566 0.99
tpcds_q61/duckdb:parquet 30840603 30946462 1.00
tpcds_q62/duckdb:parquet 11634878 12143856 0.96
tpcds_q63/duckdb:parquet 15155001 15206475 1.00
tpcds_q64/duckdb:parquet 73040874 74250430 0.98
tpcds_q65/duckdb:parquet 20059394 21441922 0.94
tpcds_q66/duckdb:parquet 54056441 57137076 0.95
tpcds_q67/duckdb:parquet 133527056 132004004 1.01
tpcds_q68/duckdb:parquet 38022520 37553232 1.01
tpcds_q69/duckdb:parquet 37623029 37343200 1.01
tpcds_q70/duckdb:parquet 19961572 19739130 1.01
tpcds_q71/duckdb:parquet 18195988 18691441 0.97
tpcds_q72/duckdb:parquet 165723351 162600082 1.02
tpcds_q73/duckdb:parquet 17999292 17666628 1.02
tpcds_q74/duckdb:parquet 49907236 49691381 1.00
tpcds_q75/duckdb:parquet 52736882 52441150 1.01
tpcds_q76/duckdb:parquet 70060354 76204946 0.92
tpcds_q77/duckdb:parquet 60869596 63694798 0.96
tpcds_q78/duckdb:parquet 73248874 74346133 0.99
tpcds_q79/duckdb:parquet 27127346 27551921 0.98
tpcds_q80/duckdb:parquet 84082499 83835543 1.00
tpcds_q81/duckdb:parquet 45594399 47143220 0.97
tpcds_q82/duckdb:parquet 16814441 15765922 1.07
tpcds_q83/duckdb:parquet 16046604 16083057 1.00
tpcds_q84/duckdb:parquet 18264444 19343888 0.94
tpcds_q85/duckdb:parquet 38365072 39490811 0.97
tpcds_q86/duckdb:parquet 12296534 12333689 1.00
tpcds_q87/duckdb:parquet 36745202 35777134 1.03
tpcds_q88/duckdb:parquet 28717111 28896271 0.99
tpcds_q89/duckdb:parquet 17356331 16817384 1.03
tpcds_q90/duckdb:parquet 7227965 7813864 0.93
tpcds_q91/duckdb:parquet 22185481 23649086 0.94
tpcds_q92/duckdb:parquet 12224733 11992634 1.02
tpcds_q93/duckdb:parquet 29801519 29923718 1.00
tpcds_q94/duckdb:parquet 16542733 16322467 1.01
tpcds_q95/duckdb:parquet 129377119 140821560 0.92
tpcds_q96/duckdb:parquet 9148851 9052004 1.01
tpcds_q97/duckdb:parquet 35814773 34404864 1.04
tpcds_q98/duckdb:parquet 18688163 18190549 1.03
tpcds_q99/duckdb:parquet 19594445 19347028 1.01
duckdb / duckdb (0.999x ➖, 1↑ 2↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20319508 20279869 1.00
tpcds_q02/duckdb:duckdb 18496295 18316087 1.01
tpcds_q03/duckdb:duckdb 8662052 8662593 1.00
tpcds_q04/duckdb:duckdb 157360192 161217859 0.98
tpcds_q05/duckdb:duckdb 18339605 18577563 0.99
tpcds_q06/duckdb:duckdb 22013690 22305989 0.99
tpcds_q07/duckdb:duckdb 38381453 38210831 1.00
tpcds_q08/duckdb:duckdb 119699570 118963434 1.01
tpcds_q09/duckdb:duckdb 19314341 19828611 0.97
tpcds_q10/duckdb:duckdb 23740022 23314822 1.02
tpcds_q11/duckdb:duckdb 137849660 140265755 0.98
tpcds_q12/duckdb:duckdb 10884942 10857501 1.00
tpcds_q13/duckdb:duckdb 23116555 23216822 1.00
tpcds_q14/duckdb:duckdb 93152129 88715436 1.05
tpcds_q15/duckdb:duckdb 24623184 23577098 1.04
tpcds_q16/duckdb:duckdb 17156165 18310081 0.94
tpcds_q17/duckdb:duckdb 20268217 21756926 0.93
tpcds_q18/duckdb:duckdb 42988993 43814195 0.98
tpcds_q19/duckdb:duckdb 16154913 16205361 1.00
tpcds_q20/duckdb:duckdb 12027130 12282416 0.98
tpcds_q21/duckdb:duckdb 🚀 6422599 7737494 0.83
tpcds_q22/duckdb:duckdb 61410639 62972375 0.98
tpcds_q23/duckdb:duckdb 71181750 72966625 0.98
tpcds_q24/duckdb:duckdb 22407256 21825972 1.03
tpcds_q25/duckdb:duckdb 17057774 17240187 0.99
tpcds_q26/duckdb:duckdb 26448351 25864066 1.02
tpcds_q27/duckdb:duckdb 39192619 38540239 1.02
tpcds_q28/duckdb:duckdb 21004026 21044232 1.00
tpcds_q29/duckdb:duckdb 19930130 19861342 1.00
tpcds_q30/duckdb:duckdb 26508957 28984922 0.91
tpcds_q31/duckdb:duckdb 19512983 20251765 0.96
tpcds_q32/duckdb:duckdb 7350494 7327848 1.00
tpcds_q33/duckdb:duckdb 12166710 12471955 0.98
tpcds_q34/duckdb:duckdb 14219260 14432453 0.99
tpcds_q35/duckdb:duckdb 33230900 32402724 1.03
tpcds_q36/duckdb:duckdb 67868363 70061310 0.97
tpcds_q37/duckdb:duckdb 7271953 7365348 0.99
tpcds_q38/duckdb:duckdb 🚨 33140450 30101624 1.10
tpcds_q39/duckdb:duckdb 26061133 26446396 0.99
tpcds_q40/duckdb:duckdb 14149239 14064108 1.01
tpcds_q41/duckdb:duckdb 8103670 7887272 1.03
tpcds_q42/duckdb:duckdb 6033527 6098900 0.99
tpcds_q43/duckdb:duckdb 10951938 11076041 0.99
tpcds_q44/duckdb:duckdb 13547915 13196738 1.03
tpcds_q45/duckdb:duckdb 16993159 17408405 0.98
tpcds_q46/duckdb:duckdb 34853191 35191857 0.99
tpcds_q47/duckdb:duckdb 41140886 41149268 1.00
tpcds_q48/duckdb:duckdb 21035275 22990139 0.91
tpcds_q49/duckdb:duckdb 17267170 16456663 1.05
tpcds_q50/duckdb:duckdb 14062106 13671968 1.03
tpcds_q51/duckdb:duckdb 91369975 90483824 1.01
tpcds_q52/duckdb:duckdb 7580559 7030087 1.08
tpcds_q53/duckdb:duckdb 11734521 11592628 1.01
tpcds_q54/duckdb:duckdb 16560861 16504097 1.00
tpcds_q55/duckdb:duckdb 6882229 6859412 1.00
tpcds_q56/duckdb:duckdb 12769142 12995388 0.98
tpcds_q57/duckdb:duckdb 30847341 31071909 0.99
tpcds_q58/duckdb:duckdb 12660279 11974217 1.06
tpcds_q59/duckdb:duckdb 34547816 34220363 1.01
tpcds_q60/duckdb:duckdb 14917255 14933963 1.00
tpcds_q61/duckdb:duckdb 14905250 14164437 1.05
tpcds_q62/duckdb:duckdb 9140951 8970425 1.02
tpcds_q63/duckdb:duckdb 11100000 10879325 1.02
tpcds_q64/duckdb:duckdb 53892908 53478661 1.01
tpcds_q65/duckdb:duckdb 32733000 31732643 1.03
tpcds_q66/duckdb:duckdb 24491883 24159508 1.01
tpcds_q67/duckdb:duckdb 127094152 130777400 0.97
tpcds_q68/duckdb:duckdb 24443647 24824935 0.98
tpcds_q69/duckdb:duckdb 23603443 23098364 1.02
tpcds_q70/duckdb:duckdb 13854701 15113755 0.92
tpcds_q71/duckdb:duckdb 12447304 12141229 1.03
tpcds_q72/duckdb:duckdb 43027227 40994970 1.05
tpcds_q73/duckdb:duckdb 10638836 11265414 0.94
tpcds_q74/duckdb:duckdb 97041874 97139103 1.00
tpcds_q75/duckdb:duckdb 41638886 41842436 1.00
tpcds_q76/duckdb:duckdb 11990330 11539821 1.04
tpcds_q77/duckdb:duckdb 12150886 11738908 1.04
tpcds_q78/duckdb:duckdb 61503847 63848525 0.96
tpcds_q79/duckdb:duckdb 17391769 17322036 1.00
tpcds_q80/duckdb:duckdb 28578917 27713477 1.03
tpcds_q81/duckdb:duckdb 35374978 36312114 0.97
tpcds_q82/duckdb:duckdb 8248330 8507041 0.97
tpcds_q83/duckdb:duckdb 8725992 8795518 0.99
tpcds_q84/duckdb:duckdb 13376787 13699276 0.98
tpcds_q85/duckdb:duckdb 23110794 24127877 0.96
tpcds_q86/duckdb:duckdb 10270343 10199131 1.01
tpcds_q87/duckdb:duckdb 32470359 32714064 0.99
tpcds_q88/duckdb:duckdb 23856502 23938244 1.00
tpcds_q89/duckdb:duckdb 13601314 13349776 1.02
tpcds_q90/duckdb:duckdb 5426914 5285634 1.03
tpcds_q91/duckdb:duckdb 12586241 12771838 0.99
tpcds_q92/duckdb:duckdb 9147129 8812678 1.04
tpcds_q93/duckdb:duckdb 22514729 22086654 1.02
tpcds_q94/duckdb:duckdb 12691014 12577816 1.01
tpcds_q95/duckdb:duckdb 🚨 126492300 108856537 1.16
tpcds_q96/duckdb:duckdb 4467575 4509516 0.99
tpcds_q97/duckdb:duckdb 30718430 30634838 1.00
tpcds_q98/duckdb:duckdb 13064202 13821369 0.95
tpcds_q99/duckdb:duckdb 16103983 15888993 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +7.1% -0.0% +7.1% +11.6% ➖ noise
1 datafusion:vortex-file-compressed -1.7% -0.0% -1.7% +12.7% ➖ noise
1 duckdb:duckdb +0.2% -0.0% +0.2% +18.9% ➖ noise
1 duckdb:vortex-compact -4.0% -0.0% -3.9% +12.3% ➖ noise
1 duckdb:vortex-file-compressed -4.9% -0.0% -4.9% +17.0% ➖ noise
2 datafusion:vortex-compact -0.9% +1.9% -2.8% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +0.2% +1.9% -1.7% +10.0% ➖ noise
2 duckdb:duckdb +1.0% +1.9% -0.9% +10.0% ➖ noise
2 duckdb:vortex-compact -1.0% +1.9% -2.8% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -4.2% +1.9% -6.0% +10.0% ➖ noise
3 datafusion:vortex-compact +1.4% -0.7% +2.0% +10.8% ➖ noise
3 datafusion:vortex-file-compressed +0.2% -0.7% +0.9% +10.1% ➖ noise
3 duckdb:duckdb -0.0% -0.7% +0.7% +15.3% ➖ noise
3 duckdb:vortex-compact -0.8% -0.7% -0.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.8% -0.7% +1.5% +10.0% ➖ noise
4 datafusion:vortex-compact -0.7% -0.7% -0.0% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +1.4% -0.7% +2.1% +10.0% ➖ noise
4 duckdb:duckdb -2.4% -0.7% -1.7% +10.0% ➖ noise
4 duckdb:vortex-compact -0.6% -0.7% +0.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +3.1% -0.7% +3.8% +11.8% ➖ noise
5 datafusion:vortex-compact +3.2% +1.1% +2.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +4.5% +1.1% +3.3% +11.7% ➖ noise
5 duckdb:duckdb -1.3% +1.1% -2.4% +13.8% ➖ noise
5 duckdb:vortex-compact +7.3% +1.1% +6.1% +12.1% ➖ noise
5 duckdb:vortex-file-compressed +4.4% +1.1% +3.3% +12.1% ➖ noise
6 datafusion:vortex-compact -2.5% -3.1% +0.6% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +1.4% -3.1% +4.6% +10.0% ➖ noise
6 duckdb:duckdb -1.3% -3.1% +1.8% +13.9% ➖ noise
6 duckdb:vortex-compact +0.6% -3.1% +3.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.2% -3.1% +3.4% +10.0% ➖ noise
7 datafusion:vortex-compact -3.1% +0.6% -3.7% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +2.9% +0.6% +2.3% +10.0% ➖ noise
7 duckdb:duckdb +0.4% +0.6% -0.2% +17.4% ➖ noise
7 duckdb:vortex-compact +5.6% +0.6% +5.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.0% +0.6% +0.4% +10.0% ➖ noise
8 datafusion:vortex-compact -1.1% +1.8% -2.9% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +1.9% +1.8% +0.1% +11.2% ➖ noise
8 duckdb:duckdb +0.6% +1.8% -1.2% +10.0% ➖ noise
8 duckdb:vortex-compact +2.3% +1.8% +0.4% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -2.0% +1.8% -3.7% +10.0% ➖ noise
9 datafusion:vortex-compact -1.4% +1.2% -2.5% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +2.1% +1.2% +0.9% +10.0% ➖ noise
9 duckdb:duckdb -2.6% +1.2% -3.7% +10.0% ➖ noise
9 duckdb:vortex-compact +2.7% +1.2% +1.5% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.4% +1.2% -0.8% +10.0% ➖ noise
10 datafusion:vortex-compact +2.4% -0.5% +2.9% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +6.0% -0.5% +6.6% +10.6% ➖ noise
10 duckdb:duckdb +1.8% -0.5% +2.4% +10.6% ➖ noise
10 duckdb:vortex-compact -0.4% -0.5% +0.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.5% -0.5% +1.0% +10.0% ➖ noise
11 datafusion:vortex-compact -0.4% +0.8% -1.2% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +4.1% +0.8% +3.3% +10.0% ➖ noise
11 duckdb:duckdb -1.7% +0.8% -2.5% +10.0% ➖ noise
11 duckdb:vortex-compact -2.3% +0.8% -3.1% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +0.7% +0.8% -0.1% +10.0% ➖ noise
12 datafusion:vortex-compact +0.2% -0.0% +0.2% +10.2% ➖ noise
12 datafusion:vortex-file-compressed -5.3% -0.0% -5.3% +12.4% ➖ noise
12 duckdb:duckdb +0.3% -0.0% +0.3% +10.6% ➖ noise
12 duckdb:vortex-compact +8.0% -0.0% +8.1% +13.2% ➖ noise
12 duckdb:vortex-file-compressed -0.1% -0.0% -0.1% +10.6% ➖ noise
13 datafusion:vortex-compact +0.8% -0.7% +1.6% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.4% -0.7% -0.7% +10.0% ➖ noise
13 duckdb:duckdb -0.4% -0.7% +0.3% +10.0% ➖ noise
13 duckdb:vortex-compact +3.1% -0.7% +3.8% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +3.2% -0.7% +4.0% +11.2% ➖ noise
14 datafusion:vortex-compact +0.8% -1.4% +2.2% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +1.2% -1.4% +2.7% +10.0% ➖ noise
14 duckdb:duckdb +5.0% -1.4% +6.5% +10.0% ➖ noise
14 duckdb:vortex-compact +8.6% -1.4% +10.2% +13.8% ➖ noise
14 duckdb:vortex-file-compressed -4.9% -1.4% -3.5% +10.0% ➖ noise
15 datafusion:vortex-compact +10.1% -1.4% +11.7% +13.8% ➖ noise
15 datafusion:vortex-file-compressed -1.5% -1.4% -0.1% +10.0% ➖ noise
15 duckdb:duckdb +4.4% -1.4% +5.9% +10.4% ➖ noise
15 duckdb:vortex-compact -1.8% -1.4% -0.4% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.1% -1.4% +1.3% +10.0% ➖ noise
16 datafusion:vortex-compact +0.8% -0.8% +1.7% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -2.8% -0.8% -2.0% +10.0% ➖ noise
16 duckdb:duckdb -6.3% -0.8% -5.5% +16.6% ➖ noise
16 duckdb:vortex-compact +1.5% -0.8% +2.4% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +2.7% -0.8% +3.6% +10.3% ➖ noise
17 datafusion:vortex-compact -1.7% +2.9% -4.5% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -0.8% +2.9% -3.7% +10.0% ➖ noise
17 duckdb:duckdb -6.8% +2.9% -9.5% +10.0% ✅ faster
17 duckdb:vortex-compact -6.1% +2.9% -8.8% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -1.5% +2.9% -4.3% +10.0% ➖ noise
18 datafusion:vortex-compact +1.2% +0.5% +0.6% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -3.0% +0.5% -3.5% +10.0% ➖ noise
18 duckdb:duckdb -1.9% +0.5% -2.4% +13.1% ➖ noise
18 duckdb:vortex-compact -0.2% +0.5% -0.7% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -3.0% +0.5% -3.6% +10.0% ➖ noise
19 datafusion:vortex-compact -0.9% -2.8% +1.9% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -0.6% -2.8% +2.2% +10.0% ➖ noise
19 duckdb:duckdb -0.3% -2.8% +2.5% +10.0% ➖ noise
19 duckdb:vortex-compact +1.3% -2.8% +4.2% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +0.9% -2.8% +3.8% +10.0% ➖ noise
20 datafusion:vortex-compact +0.4% -2.6% +3.0% +14.8% ➖ noise
20 datafusion:vortex-file-compressed -2.2% -2.6% +0.3% +10.0% ➖ noise
20 duckdb:duckdb -2.1% -2.6% +0.5% +12.2% ➖ noise
20 duckdb:vortex-compact -9.9% -2.6% -7.6% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -4.8% -2.6% -2.3% +10.0% ➖ noise
21 datafusion:vortex-compact -2.5% +8.0% -9.7% +10.3% ✅ faster
21 datafusion:vortex-file-compressed +4.5% +8.0% -3.3% +10.0% ➖ noise
21 duckdb:duckdb -17.0% +8.0% -23.1% +22.6% ✅ faster
21 duckdb:vortex-compact -0.9% +8.0% -8.2% +11.7% ➖ noise
21 duckdb:vortex-file-compressed -0.2% +8.0% -7.6% +20.6% ➖ noise
22 datafusion:vortex-compact +1.6% +15.7% -12.2% +12.9% ✅ faster
22 datafusion:vortex-file-compressed +0.5% +15.7% -13.2% +15.1% ✅ faster
22 duckdb:duckdb -2.5% +15.7% -15.7% +12.0% ✅ faster
22 duckdb:vortex-compact +1.0% +15.7% -12.7% +10.0% ✅ faster
22 duckdb:vortex-file-compressed -1.4% +15.7% -14.8% +10.0% ✅ faster
23 datafusion:vortex-compact -1.6% +2.2% -3.7% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +0.9% +2.2% -1.3% +10.0% ➖ noise
23 duckdb:duckdb -2.4% +2.2% -4.5% +20.1% ➖ noise
23 duckdb:vortex-compact -4.2% +2.2% -6.2% +10.6% ➖ noise
23 duckdb:vortex-file-compressed -3.1% +2.2% -5.2% +10.0% ➖ noise
24 datafusion:vortex-compact -0.9% -2.1% +1.2% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -3.0% -2.1% -0.9% +10.0% ➖ noise
24 duckdb:duckdb +2.7% -2.1% +4.8% +11.0% ➖ noise
24 duckdb:vortex-compact +0.6% -2.1% +2.8% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -2.8% -2.1% -0.7% +10.2% ➖ noise
25 datafusion:vortex-compact +0.6% -0.1% +0.7% +10.0% ➖ noise
25 datafusion:vortex-file-compressed +1.4% -0.1% +1.6% +10.0% ➖ noise
25 duckdb:duckdb -1.1% -0.1% -0.9% +11.3% ➖ noise
25 duckdb:vortex-compact +4.2% -0.1% +4.3% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -3.2% -0.1% -3.0% +10.0% ➖ noise
26 datafusion:vortex-compact -0.8% +1.3% -2.0% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +1.2% +1.3% -0.1% +10.0% ➖ noise
26 duckdb:duckdb +2.3% +1.3% +1.0% +17.0% ➖ noise
26 duckdb:vortex-compact -4.1% +1.3% -5.3% +13.9% ➖ noise
26 duckdb:vortex-file-compressed +4.1% +1.3% +2.8% +10.8% ➖ noise
27 datafusion:vortex-compact -2.0% +0.3% -2.3% +10.0% ➖ noise
27 datafusion:vortex-file-compressed -0.6% +0.3% -0.9% +10.0% ➖ noise
27 duckdb:duckdb +1.7% +0.3% +1.3% +13.2% ➖ noise
27 duckdb:vortex-compact +0.8% +0.3% +0.4% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +0.3% +0.3% -0.1% +10.0% ➖ noise
28 datafusion:vortex-compact +0.8% -0.0% +0.8% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -1.0% -0.0% -0.9% +10.0% ➖ noise
28 duckdb:duckdb -0.2% -0.0% -0.1% +10.0% ➖ noise
28 duckdb:vortex-compact +0.9% -0.0% +0.9% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.8% -0.0% -0.8% +10.0% ➖ noise
29 datafusion:vortex-compact -0.3% -3.8% +3.7% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +2.1% -3.8% +6.2% +10.0% ➖ noise
29 duckdb:duckdb +0.3% -3.8% +4.4% +10.0% ➖ noise
29 duckdb:vortex-compact -0.6% -3.8% +3.4% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +4.3% -3.8% +8.5% +13.0% ➖ noise
30 datafusion:vortex-compact -5.7% -1.6% -4.2% +10.0% ➖ noise
30 datafusion:vortex-file-compressed -0.4% -1.6% +1.2% +10.0% ➖ noise
30 duckdb:duckdb -8.5% -1.6% -7.1% +10.6% ➖ noise
30 duckdb:vortex-compact +4.0% -1.6% +5.6% +13.6% ➖ noise
30 duckdb:vortex-file-compressed +4.2% -1.6% +5.8% +10.5% ➖ noise
31 datafusion:vortex-compact +0.8% +2.3% -1.5% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -2.1% +2.3% -4.4% +10.0% ➖ noise
31 duckdb:duckdb -3.6% +2.3% -5.8% +11.3% ➖ noise
31 duckdb:vortex-compact -2.2% +2.3% -4.4% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +1.0% +2.3% -1.3% +10.5% ➖ noise
32 datafusion:vortex-compact -1.7% -4.2% +2.7% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +9.9% -4.2% +14.8% +10.0% 🚨 regression
32 duckdb:duckdb +0.3% -4.2% +4.7% +11.7% ➖ noise
32 duckdb:vortex-compact -2.1% -4.2% +2.3% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -5.4% -4.2% -1.3% +12.7% ➖ noise
33 datafusion:vortex-compact +1.1% +2.5% -1.4% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +1.5% +2.5% -1.0% +10.0% ➖ noise
33 duckdb:duckdb -2.4% +2.5% -4.8% +11.7% ➖ noise
33 duckdb:vortex-compact -3.2% +2.5% -5.6% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +1.4% +2.5% -1.0% +15.1% ➖ noise
34 datafusion:vortex-compact -1.3% +0.4% -1.6% +10.2% ➖ noise
34 datafusion:vortex-file-compressed +2.8% +0.4% +2.4% +10.0% ➖ noise
34 duckdb:duckdb -1.5% +0.4% -1.9% +10.4% ➖ noise
34 duckdb:vortex-compact +1.3% +0.4% +0.9% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -0.0% +0.4% -0.4% +10.3% ➖ noise
35 datafusion:vortex-compact +0.4% -2.8% +3.2% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -1.1% -2.8% +1.8% +10.0% ➖ noise
35 duckdb:duckdb +2.6% -2.8% +5.5% +15.2% ➖ noise
35 duckdb:vortex-compact +4.5% -2.8% +7.5% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +8.7% -2.8% +11.8% +10.4% 🚨 regression
36 datafusion:vortex-compact +2.3% +0.7% +1.6% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +0.7% +0.7% +0.0% +10.0% ➖ noise
36 duckdb:duckdb -3.1% +0.7% -3.8% +11.4% ➖ noise
36 duckdb:vortex-compact -2.9% +0.7% -3.5% +12.4% ➖ noise
36 duckdb:vortex-file-compressed -2.2% +0.7% -2.8% +10.0% ➖ noise
37 datafusion:vortex-compact +0.3% -3.3% +3.7% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +2.1% -3.3% +5.6% +11.5% ➖ noise
37 duckdb:duckdb -1.3% -3.3% +2.1% +16.9% ➖ noise
37 duckdb:vortex-compact +2.3% -3.3% +5.8% +14.1% ➖ noise
37 duckdb:vortex-file-compressed +0.7% -3.3% +4.1% +14.3% ➖ noise
38 datafusion:vortex-compact +2.6% +2.7% -0.1% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -2.2% +2.7% -4.7% +10.0% ➖ noise
38 duckdb:duckdb +10.1% +2.7% +7.2% +14.0% ➖ noise
38 duckdb:vortex-compact +1.3% +2.7% -1.3% +16.9% ➖ noise
38 duckdb:vortex-file-compressed -0.6% +2.7% -3.2% +13.3% ➖ noise
39 datafusion:vortex-compact -2.3% -1.5% -0.8% +10.0% ➖ noise
39 datafusion:vortex-file-compressed -8.7% -1.5% -7.2% +10.0% ➖ noise
39 duckdb:duckdb -1.5% -1.5% +0.1% +16.5% ➖ noise
39 duckdb:vortex-compact -6.0% -1.5% -4.5% +18.1% ➖ noise
39 duckdb:vortex-file-compressed -1.3% -1.5% +0.3% +10.0% ➖ noise
40 datafusion:vortex-compact -0.0% +2.7% -2.6% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +2.2% +2.7% -0.5% +10.0% ➖ noise
40 duckdb:duckdb +0.6% +2.7% -2.0% +14.6% ➖ noise
40 duckdb:vortex-compact +3.8% +2.7% +1.2% +13.9% ➖ noise
40 duckdb:vortex-file-compressed -1.5% +2.7% -4.1% +12.5% ➖ noise
41 datafusion:vortex-compact +0.1% +2.1% -1.9% +10.8% ➖ noise
41 datafusion:vortex-file-compressed +2.6% +2.1% +0.5% +13.9% ➖ noise
41 duckdb:duckdb +2.7% +2.1% +0.6% +10.0% ➖ noise
41 duckdb:vortex-compact +1.7% +2.1% -0.4% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -1.2% +2.1% -3.2% +10.0% ➖ noise
42 datafusion:vortex-compact +4.2% +2.0% +2.1% +13.5% ➖ noise
42 datafusion:vortex-file-compressed +0.9% +2.0% -1.1% +11.4% ➖ noise
42 duckdb:duckdb -1.1% +2.0% -3.1% +15.3% ➖ noise
42 duckdb:vortex-compact -4.1% +2.0% -6.0% +14.8% ➖ noise
42 duckdb:vortex-file-compressed -2.3% +2.0% -4.2% +18.2% ➖ noise
43 datafusion:vortex-compact +1.8% +1.6% +0.2% +10.0% ➖ noise
43 datafusion:vortex-file-compressed -1.7% +1.6% -3.3% +10.0% ➖ noise
43 duckdb:duckdb -1.1% +1.6% -2.7% +10.0% ➖ noise
43 duckdb:vortex-compact -0.8% +1.6% -2.3% +34.8% ➖ noise
43 duckdb:vortex-file-compressed -0.5% +1.6% -2.0% +27.0% ➖ noise
44 datafusion:vortex-compact -2.7% -0.9% -1.8% +10.0% ➖ noise
44 datafusion:vortex-file-compressed +0.4% -0.9% +1.3% +10.0% ➖ noise
44 duckdb:duckdb +2.7% -0.9% +3.6% +33.2% ➖ noise
44 duckdb:vortex-compact -3.5% -0.9% -2.6% +10.0% ➖ noise
44 duckdb:vortex-file-compressed -3.1% -0.9% -2.2% +10.0% ➖ noise
45 datafusion:vortex-compact -1.7% +2.1% -3.8% +10.0% ➖ noise
45 datafusion:vortex-file-compressed +1.1% +2.1% -1.0% +10.0% ➖ noise
45 duckdb:duckdb -2.4% +2.1% -4.4% +10.0% ➖ noise
45 duckdb:vortex-compact +1.0% +2.1% -1.1% +10.0% ➖ noise
45 duckdb:vortex-file-compressed -4.0% +2.1% -6.0% +16.6% ➖ noise
46 datafusion:vortex-compact +1.8% -2.0% +3.9% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -1.1% -2.0% +0.9% +10.5% ➖ noise
46 duckdb:duckdb -1.0% -2.0% +1.1% +10.0% ➖ noise
46 duckdb:vortex-compact +2.3% -2.0% +4.5% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +0.8% -2.0% +2.8% +10.0% ➖ noise
47 datafusion:vortex-compact +0.9% -0.9% +1.8% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +1.9% -0.9% +2.8% +10.0% ➖ noise
47 duckdb:duckdb -0.0% -0.9% +0.9% +10.0% ➖ noise
47 duckdb:vortex-compact -0.2% -0.9% +0.7% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -1.9% -0.9% -1.0% +10.8% ➖ noise
48 datafusion:vortex-compact -9.1% -2.9% -6.3% +10.3% ➖ noise
48 datafusion:vortex-file-compressed +1.0% -2.9% +4.1% +10.0% ➖ noise
48 duckdb:duckdb -8.5% -2.9% -5.7% +10.5% ➖ noise
48 duckdb:vortex-compact -0.2% -2.9% +2.8% +10.0% ➖ noise
48 duckdb:vortex-file-compressed +3.7% -2.9% +6.8% +10.5% ➖ noise
49 datafusion:vortex-compact -0.9% -3.1% +2.3% +10.0% ➖ noise
49 datafusion:vortex-file-compressed -5.4% -3.1% -2.3% +10.0% ➖ noise
49 duckdb:duckdb +4.9% -3.1% +8.3% +15.0% ➖ noise
49 duckdb:vortex-compact +10.7% -3.1% +14.3% +10.6% 🚨 regression
49 duckdb:vortex-file-compressed -0.4% -3.1% +2.7% +17.5% ➖ noise
50 datafusion:vortex-compact -0.6% +1.5% -2.0% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -0.8% +1.5% -2.3% +10.0% ➖ noise
50 duckdb:duckdb +2.9% +1.5% +1.4% +11.9% ➖ noise
50 duckdb:vortex-compact -0.6% +1.5% -2.0% +10.0% ➖ noise
50 duckdb:vortex-file-compressed -0.8% +1.5% -2.3% +10.0% ➖ noise
51 datafusion:vortex-compact +2.1% -0.3% +2.4% +10.0% ➖ noise
51 datafusion:vortex-file-compressed -0.7% -0.3% -0.4% +10.0% ➖ noise
51 duckdb:duckdb +1.0% -0.3% +1.3% +10.0% ➖ noise
51 duckdb:vortex-compact -18.4% -0.3% -18.2% +17.3% ✅ faster
51 duckdb:vortex-file-compressed -1.2% -0.3% -0.8% +30.3% ➖ noise
52 datafusion:vortex-compact +1.4% +5.1% -3.6% +10.0% ➖ noise
52 datafusion:vortex-file-compressed -7.3% +5.1% -11.8% +16.4% ➖ noise
52 duckdb:duckdb +7.8% +5.1% +2.6% +40.8% ➖ noise
52 duckdb:vortex-compact +3.7% +5.1% -1.4% +14.7% ➖ noise
52 duckdb:vortex-file-compressed -3.3% +5.1% -8.0% +33.8% ➖ noise
53 datafusion:vortex-compact -3.3% -4.7% +1.5% +13.7% ➖ noise
53 datafusion:vortex-file-compressed +3.4% -4.7% +8.5% +10.0% ➖ noise
53 duckdb:duckdb +1.2% -4.7% +6.3% +10.0% ➖ noise
53 duckdb:vortex-compact -0.3% -4.7% +4.7% +10.0% ➖ noise
53 duckdb:vortex-file-compressed +1.9% -4.7% +7.0% +11.0% ➖ noise
54 datafusion:vortex-compact +3.2% +0.9% +2.3% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -1.6% +0.9% -2.5% +10.0% ➖ noise
54 duckdb:duckdb +0.3% +0.9% -0.5% +10.6% ➖ noise
54 duckdb:vortex-compact +1.6% +0.9% +0.7% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +3.0% +0.9% +2.1% +10.9% ➖ noise
55 datafusion:vortex-compact -1.0% -1.0% +0.1% +11.3% ➖ noise
55 datafusion:vortex-file-compressed -0.1% -1.0% +1.0% +10.0% ➖ noise
55 duckdb:duckdb +0.3% -1.0% +1.4% +15.6% ➖ noise
55 duckdb:vortex-compact +1.3% -1.0% +2.4% +10.0% ➖ noise
55 duckdb:vortex-file-compressed +1.4% -1.0% +2.4% +14.9% ➖ noise
56 datafusion:vortex-compact -0.6% +3.1% -3.6% +10.0% ➖ noise
56 datafusion:vortex-file-compressed +3.1% +3.1% -0.0% +10.0% ➖ noise
56 duckdb:duckdb -1.7% +3.1% -4.7% +10.0% ➖ noise
56 duckdb:vortex-compact -2.9% +3.1% -5.8% +10.0% ➖ noise
56 duckdb:vortex-file-compressed +4.2% +3.1% +1.0% +10.0% ➖ noise
57 datafusion:vortex-compact -1.1% -0.2% -0.9% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -2.2% -0.2% -2.1% +10.0% ➖ noise
57 duckdb:duckdb -0.7% -0.2% -0.6% +10.0% ➖ noise
57 duckdb:vortex-compact +0.4% -0.2% +0.6% +19.1% ➖ noise
57 duckdb:vortex-file-compressed -1.5% -0.2% -1.4% +16.9% ➖ noise
58 datafusion:vortex-compact -3.3% +1.4% -4.6% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -0.7% +1.4% -2.1% +10.0% ➖ noise
58 duckdb:duckdb +5.7% +1.4% +4.3% +19.6% ➖ noise
58 duckdb:vortex-compact +4.1% +1.4% +2.7% +12.2% ➖ noise
58 duckdb:vortex-file-compressed -7.2% +1.4% -8.5% +10.6% ➖ noise
59 datafusion:vortex-compact -1.2% +0.1% -1.4% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +3.1% +0.1% +3.0% +10.0% ➖ noise
59 duckdb:duckdb +1.0% +0.1% +0.8% +10.0% ➖ noise
59 duckdb:vortex-compact +3.7% +0.1% +3.6% +10.0% ➖ noise
59 duckdb:vortex-file-compressed -0.7% +0.1% -0.8% +10.0% ➖ noise
60 datafusion:vortex-compact -1.8% -0.4% -1.4% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -4.8% -0.4% -4.4% +10.0% ➖ noise
60 duckdb:duckdb -0.1% -0.4% +0.3% +11.1% ➖ noise
60 duckdb:vortex-compact -3.4% -0.4% -3.0% +10.0% ➖ noise
60 duckdb:vortex-file-compressed +4.2% -0.4% +4.6% +12.4% ➖ noise
61 datafusion:vortex-compact -4.6% +0.2% -4.8% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -0.8% +0.2% -0.9% +10.0% ➖ noise
61 duckdb:duckdb +5.2% +0.2% +5.0% +10.0% ➖ noise
61 duckdb:vortex-compact -1.3% +0.2% -1.5% +10.0% ➖ noise
61 duckdb:vortex-file-compressed -4.7% +0.2% -4.8% +11.3% ➖ noise
62 datafusion:vortex-compact +0.8% -9.2% +11.1% +14.4% ➖ noise
62 datafusion:vortex-file-compressed +0.7% -9.2% +10.9% +15.7% ➖ noise
62 duckdb:duckdb +1.9% -9.2% +12.2% +14.9% ➖ noise
62 duckdb:vortex-compact -18.2% -9.2% -9.9% +31.7% ➖ noise
62 duckdb:vortex-file-compressed -20.1% -9.2% -12.0% +21.8% ➖ noise
63 datafusion:vortex-compact -1.7% -1.4% -0.3% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -2.6% -1.4% -1.3% +10.0% ➖ noise
63 duckdb:duckdb +2.0% -1.4% +3.5% +10.0% ➖ noise
63 duckdb:vortex-compact -3.9% -1.4% -2.5% +10.0% ➖ noise
63 duckdb:vortex-file-compressed +3.1% -1.4% +4.6% +11.7% ➖ noise
64 datafusion:vortex-compact +1.2% -1.0% +2.2% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +0.2% -1.0% +1.2% +10.0% ➖ noise
64 duckdb:duckdb +0.8% -1.0% +1.8% +10.0% ➖ noise
64 duckdb:vortex-compact +1.3% -1.0% +2.3% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -1.0% -1.0% -0.0% +10.0% ➖ noise
65 datafusion:vortex-compact +0.6% -4.4% +5.2% +10.0% ➖ noise
65 datafusion:vortex-file-compressed -2.2% -4.4% +2.3% +10.0% ➖ noise
65 duckdb:duckdb +3.2% -4.4% +7.9% +12.1% ➖ noise
65 duckdb:vortex-compact +0.8% -4.4% +5.4% +10.0% ➖ noise
65 duckdb:vortex-file-compressed +3.5% -4.4% +8.3% +15.0% ➖ noise
66 datafusion:vortex-compact -0.8% -1.9% +1.1% +10.8% ➖ noise
66 datafusion:vortex-file-compressed +2.2% -1.9% +4.2% +12.2% ➖ noise
66 duckdb:duckdb +1.4% -1.9% +3.3% +12.2% ➖ noise
66 duckdb:vortex-compact -7.8% -1.9% -6.0% +14.7% ➖ noise
66 duckdb:vortex-file-compressed -2.2% -1.9% -0.3% +14.4% ➖ noise
67 datafusion:vortex-compact +3.4% -1.6% +5.0% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -0.4% -1.6% +1.2% +10.0% ➖ noise
67 duckdb:duckdb -2.8% -1.6% -1.3% +10.0% ➖ noise
67 duckdb:vortex-compact +1.2% -1.6% +2.8% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -2.1% -1.6% -0.5% +10.0% ➖ noise
68 datafusion:vortex-compact -0.1% -0.9% +0.8% +10.0% ➖ noise
68 datafusion:vortex-file-compressed +2.7% -0.9% +3.6% +10.0% ➖ noise
68 duckdb:duckdb -1.5% -0.9% -0.6% +10.0% ➖ noise
68 duckdb:vortex-compact -1.3% -0.9% -0.4% +10.0% ➖ noise
68 duckdb:vortex-file-compressed +3.2% -0.9% +4.1% +10.0% ➖ noise
69 datafusion:vortex-compact -2.5% +0.7% -3.1% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -0.7% +0.7% -1.4% +10.0% ➖ noise
69 duckdb:duckdb +2.2% +0.7% +1.5% +10.0% ➖ noise
69 duckdb:vortex-compact -5.9% +0.7% -6.5% +10.0% ➖ noise
69 duckdb:vortex-file-compressed -3.1% +0.7% -3.8% +10.3% ➖ noise
70 datafusion:vortex-compact -2.0% +2.8% -4.6% +10.0% ➖ noise
70 datafusion:vortex-file-compressed +1.3% +2.8% -1.5% +10.0% ➖ noise
70 duckdb:duckdb -8.3% +2.8% -10.8% +16.3% ➖ noise
70 duckdb:vortex-compact +1.9% +2.8% -0.8% +17.5% ➖ noise
70 duckdb:vortex-file-compressed +3.4% +2.8% +0.6% +10.2% ➖ noise
71 datafusion:vortex-compact +1.3% -1.5% +2.8% +10.0% ➖ noise
71 datafusion:vortex-file-compressed -7.8% -1.5% -6.4% +10.9% ➖ noise
71 duckdb:duckdb +2.5% -1.5% +4.1% +13.6% ➖ noise
71 duckdb:vortex-compact -1.5% -1.5% -0.0% +13.7% ➖ noise
71 duckdb:vortex-file-compressed -2.7% -1.5% -1.2% +14.8% ➖ noise
72 datafusion:vortex-compact +0.1% +1.6% -1.5% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +0.7% +1.6% -1.0% +10.0% ➖ noise
72 duckdb:duckdb +5.0% +1.6% +3.3% +13.0% ➖ noise
72 duckdb:vortex-compact +1.8% +1.6% +0.1% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -0.4% +1.6% -2.0% +10.0% ➖ noise
73 datafusion:vortex-compact +4.3% -1.1% +5.5% +13.0% ➖ noise
73 datafusion:vortex-file-compressed -1.2% -1.1% -0.1% +28.9% ➖ noise
73 duckdb:duckdb -5.6% -1.1% -4.5% +12.4% ➖ noise
73 duckdb:vortex-compact -2.4% -1.1% -1.3% +10.2% ➖ noise
73 duckdb:vortex-file-compressed +0.9% -1.1% +2.1% +10.0% ➖ noise
74 datafusion:vortex-compact +0.5% +0.3% +0.2% +10.0% ➖ noise
74 datafusion:vortex-file-compressed -0.9% +0.3% -1.2% +10.0% ➖ noise
74 duckdb:duckdb -0.1% +0.3% -0.4% +10.0% ➖ noise
74 duckdb:vortex-compact -0.1% +0.3% -0.5% +10.2% ➖ noise
74 duckdb:vortex-file-compressed +0.9% +0.3% +0.5% +10.0% ➖ noise
75 datafusion:vortex-compact -4.2% +0.7% -4.9% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -1.7% +0.7% -2.4% +10.0% ➖ noise
75 duckdb:duckdb -0.5% +0.7% -1.2% +10.0% ➖ noise
75 duckdb:vortex-compact +1.9% +0.7% +1.1% +11.6% ➖ noise
75 duckdb:vortex-file-compressed -3.9% +0.7% -4.6% +10.0% ➖ noise
76 datafusion:vortex-compact +2.6% -5.2% +8.2% +10.0% ➖ noise
76 datafusion:vortex-file-compressed -2.9% -5.2% +2.4% +12.9% ➖ noise
76 duckdb:duckdb +3.9% -5.2% +9.6% +21.3% ➖ noise
76 duckdb:vortex-compact -2.0% -5.2% +3.4% +14.5% ➖ noise
76 duckdb:vortex-file-compressed -13.9% -5.2% -9.2% +24.5% ➖ noise
77 datafusion:vortex-compact +0.0% -1.6% +1.7% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -0.4% -1.6% +1.2% +10.9% ➖ noise
77 duckdb:duckdb +3.5% -1.6% +5.2% +13.4% ➖ noise
77 duckdb:vortex-compact +5.6% -1.6% +7.4% +10.0% ➖ noise
77 duckdb:vortex-file-compressed +1.9% -1.6% +3.5% +13.6% ➖ noise
78 datafusion:vortex-compact -2.1% +0.0% -2.1% +10.0% ➖ noise
78 datafusion:vortex-file-compressed +2.1% +0.0% +2.1% +10.0% ➖ noise
78 duckdb:duckdb -3.7% +0.0% -3.7% +10.0% ➖ noise
78 duckdb:vortex-compact -2.0% +0.0% -2.0% +10.0% ➖ noise
78 duckdb:vortex-file-compressed +2.4% +0.0% +2.4% +10.0% ➖ noise
79 datafusion:vortex-compact +1.1% +0.2% +0.9% +10.0% ➖ noise
79 datafusion:vortex-file-compressed +2.8% +0.2% +2.7% +10.0% ➖ noise
79 duckdb:duckdb +0.4% +0.2% +0.2% +10.4% ➖ noise
79 duckdb:vortex-compact +1.9% +0.2% +1.7% +10.0% ➖ noise
79 duckdb:vortex-file-compressed -0.4% +0.2% -0.6% +11.3% ➖ noise
80 datafusion:vortex-compact +0.9% +0.2% +0.7% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +0.1% +0.2% -0.1% +10.0% ➖ noise
80 duckdb:duckdb +3.1% +0.2% +2.9% +16.7% ➖ noise
80 duckdb:vortex-compact +1.1% +0.2% +0.9% +10.0% ➖ noise
80 duckdb:vortex-file-compressed +2.3% +0.2% +2.1% +10.0% ➖ noise
81 datafusion:vortex-compact +10.3% -2.0% +12.6% +12.3% 🚨 regression
81 datafusion:vortex-file-compressed -5.0% -2.0% -3.0% +15.2% ➖ noise
81 duckdb:duckdb -2.6% -2.0% -0.5% +11.6% ➖ noise
81 duckdb:vortex-compact -1.8% -2.0% +0.3% +12.3% ➖ noise
81 duckdb:vortex-file-compressed -0.4% -2.0% +1.7% +10.0% ➖ noise
82 datafusion:vortex-compact -1.2% +3.1% -4.2% +10.3% ➖ noise
82 datafusion:vortex-file-compressed +0.7% +3.1% -2.3% +10.0% ➖ noise
82 duckdb:duckdb -3.0% +3.1% -5.9% +13.2% ➖ noise
82 duckdb:vortex-compact +0.9% +3.1% -2.0% +11.2% ➖ noise
82 duckdb:vortex-file-compressed -4.5% +3.1% -7.3% +16.2% ➖ noise
83 datafusion:vortex-compact +0.9% +1.6% -0.7% +10.0% ➖ noise
83 datafusion:vortex-file-compressed +2.9% +1.6% +1.3% +10.0% ➖ noise
83 duckdb:duckdb -0.8% +1.6% -2.3% +13.5% ➖ noise
83 duckdb:vortex-compact -0.3% +1.6% -1.9% +10.0% ➖ noise
83 duckdb:vortex-file-compressed -2.9% +1.6% -4.4% +10.8% ➖ noise
84 datafusion:vortex-compact +2.1% -1.3% +3.4% +12.4% ➖ noise
84 datafusion:vortex-file-compressed -4.9% -1.3% -3.7% +10.0% ➖ noise
84 duckdb:duckdb -2.4% -1.3% -1.1% +16.1% ➖ noise
84 duckdb:vortex-compact +0.6% -1.3% +1.8% +10.0% ➖ noise
84 duckdb:vortex-file-compressed +2.2% -1.3% +3.5% +10.0% ➖ noise
85 datafusion:vortex-compact -3.1% -1.0% -2.1% +10.0% ➖ noise
85 datafusion:vortex-file-compressed -0.1% -1.0% +0.9% +10.0% ➖ noise
85 duckdb:duckdb -4.2% -1.0% -3.2% +12.2% ➖ noise
85 duckdb:vortex-compact -4.8% -1.0% -3.9% +10.0% ➖ noise
85 duckdb:vortex-file-compressed -0.4% -1.0% +0.6% +10.0% ➖ noise
86 datafusion:vortex-compact +1.1% +1.6% -0.4% +10.3% ➖ noise
86 datafusion:vortex-file-compressed -1.9% +1.6% -3.4% +11.9% ➖ noise
86 duckdb:duckdb +0.7% +1.6% -0.8% +14.0% ➖ noise
86 duckdb:vortex-compact +16.5% +1.6% +14.8% +20.4% ➖ noise
86 duckdb:vortex-file-compressed -5.5% +1.6% -6.9% +18.4% ➖ noise
87 datafusion:vortex-compact +1.4% +2.2% -0.8% +10.0% ➖ noise
87 datafusion:vortex-file-compressed +2.5% +2.2% +0.3% +10.0% ➖ noise
87 duckdb:duckdb -0.7% +2.2% -2.9% +10.0% ➖ noise
87 duckdb:vortex-compact -1.5% +2.2% -3.6% +16.4% ➖ noise
87 duckdb:vortex-file-compressed +10.0% +2.2% +7.7% +15.3% ➖ noise
88 datafusion:vortex-compact -0.1% +0.2% -0.3% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +0.0% +0.2% -0.2% +10.0% ➖ noise
88 duckdb:duckdb -0.3% +0.2% -0.5% +10.0% ➖ noise
88 duckdb:vortex-compact +7.3% +0.2% +7.1% +10.0% ➖ noise
88 duckdb:vortex-file-compressed -2.5% +0.2% -2.7% +10.0% ➖ noise
89 datafusion:vortex-compact -1.3% +2.7% -3.9% +10.0% ➖ noise
89 datafusion:vortex-file-compressed -3.5% +2.7% -6.0% +11.6% ➖ noise
89 duckdb:duckdb +1.9% +2.7% -0.8% +13.5% ➖ noise
89 duckdb:vortex-compact -1.1% +2.7% -3.7% +14.4% ➖ noise
89 duckdb:vortex-file-compressed -2.3% +2.7% -4.8% +12.3% ➖ noise
90 datafusion:vortex-compact +2.2% -4.4% +6.9% +10.0% ➖ noise
90 datafusion:vortex-file-compressed -0.5% -4.4% +4.0% +10.0% ➖ noise
90 duckdb:duckdb +2.7% -4.4% +7.4% +10.0% ➖ noise
90 duckdb:vortex-compact -0.1% -4.4% +4.5% +10.0% ➖ noise
90 duckdb:vortex-file-compressed +0.9% -4.4% +5.6% +10.8% ➖ noise
91 datafusion:vortex-compact +1.0% -4.5% +5.8% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +1.6% -4.5% +6.4% +10.0% ➖ noise
91 duckdb:duckdb -1.5% -4.5% +3.2% +12.5% ➖ noise
91 duckdb:vortex-compact +3.2% -4.5% +8.1% +10.0% ➖ noise
91 duckdb:vortex-file-compressed +0.7% -4.5% +5.4% +10.0% ➖ noise
92 datafusion:vortex-compact +2.2% +2.6% -0.5% +10.0% ➖ noise
92 datafusion:vortex-file-compressed +1.5% +2.6% -1.1% +10.0% ➖ noise
92 duckdb:duckdb +3.8% +2.6% +1.1% +11.6% ➖ noise
92 duckdb:vortex-compact -3.6% +2.6% -6.0% +10.8% ➖ noise
92 duckdb:vortex-file-compressed -10.3% +2.6% -12.6% +15.4% ➖ noise
93 datafusion:vortex-compact -0.4% +1.0% -1.4% +10.0% ➖ noise
93 datafusion:vortex-file-compressed +2.2% +1.0% +1.2% +10.0% ➖ noise
93 duckdb:duckdb +1.9% +1.0% +0.9% +14.4% ➖ noise
93 duckdb:vortex-compact -1.1% +1.0% -2.1% +10.0% ➖ noise
93 duckdb:vortex-file-compressed -1.9% +1.0% -2.9% +10.0% ➖ noise
94 datafusion:vortex-compact -0.7% -0.0% -0.7% +10.0% ➖ noise
94 datafusion:vortex-file-compressed -3.7% -0.0% -3.7% +10.0% ➖ noise
94 duckdb:duckdb +0.9% -0.0% +0.9% +13.2% ➖ noise
94 duckdb:vortex-compact +4.4% -0.0% +4.5% +10.3% ➖ noise
94 duckdb:vortex-file-compressed +2.5% -0.0% +2.5% +11.4% ➖ noise
95 datafusion:vortex-compact +4.7% -3.8% +8.9% +10.8% ➖ noise
95 datafusion:vortex-file-compressed +2.4% -3.8% +6.5% +10.3% ➖ noise
95 duckdb:duckdb +16.2% -3.8% +20.8% +21.6% ➖ noise
95 duckdb:vortex-compact -0.3% -3.8% +3.7% +20.3% ➖ noise
95 duckdb:vortex-file-compressed +5.7% -3.8% +9.9% +16.5% ➖ noise
96 datafusion:vortex-compact -4.1% -4.1% -0.1% +21.0% ➖ noise
96 datafusion:vortex-file-compressed +2.7% -4.1% +7.0% +13.6% ➖ noise
96 duckdb:duckdb -0.9% -4.1% +3.3% +15.5% ➖ noise
96 duckdb:vortex-compact +7.4% -4.1% +12.0% +25.4% ➖ noise
96 duckdb:vortex-file-compressed -13.0% -4.1% -9.3% +16.3% ➖ noise
97 datafusion:vortex-compact +2.3% +2.6% -0.2% +10.0% ➖ noise
97 datafusion:vortex-file-compressed +0.7% +2.6% -1.9% +10.0% ➖ noise
97 duckdb:duckdb +0.3% +2.6% -2.3% +12.0% ➖ noise
97 duckdb:vortex-compact -1.6% +2.6% -4.1% +18.1% ➖ noise
97 duckdb:vortex-file-compressed -1.8% +2.6% -4.3% +17.3% ➖ noise
98 datafusion:vortex-compact -1.0% +1.1% -2.0% +10.0% ➖ noise
98 datafusion:vortex-file-compressed -0.2% +1.1% -1.2% +10.0% ➖ noise
98 duckdb:duckdb -5.5% +1.1% -6.5% +12.6% ➖ noise
98 duckdb:vortex-compact +0.6% +1.1% -0.4% +10.3% ➖ noise
98 duckdb:vortex-file-compressed +3.5% +1.1% +2.4% +13.7% ➖ noise
99 datafusion:vortex-compact +1.2% +0.3% +0.9% +16.0% ➖ noise
99 datafusion:vortex-file-compressed -0.7% +0.3% -1.0% +20.6% ➖ noise
99 duckdb:duckdb +1.4% +0.3% +1.0% +15.9% ➖ noise
99 duckdb:vortex-compact +9.6% +0.3% +9.2% +23.8% ➖ noise
99 duckdb:vortex-file-compressed -2.8% +0.3% -3.1% +14.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Vortex (geomean): 0.997x ➖
Parquet (geomean): 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish -0.2%


datafusion / vortex-file-compressed (1.005x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 399567070 401077933 1.00
tpch_q02/datafusion:vortex-file-compressed 115058902 114134917 1.01
tpch_q03/datafusion:vortex-file-compressed 201453170 201872289 1.00
tpch_q04/datafusion:vortex-file-compressed 100101760 98478029 1.02
tpch_q05/datafusion:vortex-file-compressed 380947849 375440417 1.01
tpch_q06/datafusion:vortex-file-compressed 40930261 40579586 1.01
tpch_q07/datafusion:vortex-file-compressed 554910171 551600709 1.01
tpch_q08/datafusion:vortex-file-compressed 379488314 371792194 1.02
tpch_q09/datafusion:vortex-file-compressed 670746258 657499200 1.02
tpch_q10/datafusion:vortex-file-compressed 234561236 229932907 1.02
tpch_q11/datafusion:vortex-file-compressed 83998907 84400058 1.00
tpch_q12/datafusion:vortex-file-compressed 104867327 105686145 0.99
tpch_q13/datafusion:vortex-file-compressed 215333566 214630528 1.00
tpch_q14/datafusion:vortex-file-compressed 58409062 55562179 1.05
tpch_q15/datafusion:vortex-file-compressed 105752677 103543640 1.02
tpch_q16/datafusion:vortex-file-compressed 75293955 75952876 0.99
tpch_q17/datafusion:vortex-file-compressed 646695467 635251550 1.02
tpch_q18/datafusion:vortex-file-compressed 861457696 863640970 1.00
tpch_q19/datafusion:vortex-file-compressed 89801385 93817963 0.96
tpch_q20/datafusion:vortex-file-compressed 165852000 169241392 0.98
tpch_q21/datafusion:vortex-file-compressed 654468540 648030036 1.01
tpch_q22/datafusion:vortex-file-compressed 58246812 59434666 0.98
datafusion / vortex-compact (0.988x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 446427370 456126759 0.98
tpch_q02/datafusion:vortex-compact 115504150 118649793 0.97
tpch_q03/datafusion:vortex-compact 215516461 215089495 1.00
tpch_q04/datafusion:vortex-compact 116276147 117434426 0.99
tpch_q05/datafusion:vortex-compact 391913235 390986332 1.00
tpch_q06/datafusion:vortex-compact 61948474 61564919 1.01
tpch_q07/datafusion:vortex-compact 583543959 591498873 0.99
tpch_q08/datafusion:vortex-compact 381534416 389239903 0.98
tpch_q09/datafusion:vortex-compact 687059780 682212570 1.01
tpch_q10/datafusion:vortex-compact 266675964 275121326 0.97
tpch_q11/datafusion:vortex-compact 89154352 89632035 0.99
tpch_q12/datafusion:vortex-compact 162284145 162159771 1.00
tpch_q13/datafusion:vortex-compact 269363863 269079161 1.00
tpch_q14/datafusion:vortex-compact 72910217 72057122 1.01
tpch_q15/datafusion:vortex-compact 161023069 166092462 0.97
tpch_q16/datafusion:vortex-compact 80511717 80801954 1.00
tpch_q17/datafusion:vortex-compact 646376322 646423406 1.00
tpch_q18/datafusion:vortex-compact 868819051 894722717 0.97
tpch_q19/datafusion:vortex-compact 129344341 134635185 0.96
tpch_q20/datafusion:vortex-compact 193156216 198643654 0.97
tpch_q21/datafusion:vortex-compact 688822232 704191711 0.98
tpch_q22/datafusion:vortex-compact 70583494 71630148 0.99
datafusion / parquet (1.007x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 433665486 446002707 0.97
tpch_q02/datafusion:parquet 188153519 184073975 1.02
tpch_q03/datafusion:parquet 294170171 293944155 1.00
tpch_q04/datafusion:parquet 136117766 132903806 1.02
tpch_q05/datafusion:parquet 449833232 447584314 1.01
tpch_q06/datafusion:parquet 124156537 118184985 1.05
tpch_q07/datafusion:parquet 618132442 616542539 1.00
tpch_q08/datafusion:parquet 488854339 485803135 1.01
tpch_q09/datafusion:parquet 785419470 764540749 1.03
tpch_q10/datafusion:parquet 501801278 506588000 0.99
tpch_q11/datafusion:parquet 130113569 128258019 1.01
tpch_q12/datafusion:parquet 204131219 215916678 0.95
tpch_q13/datafusion:parquet 344813470 337654489 1.02
tpch_q14/datafusion:parquet 170975860 159362466 1.07
tpch_q15/datafusion:parquet 237740108 233050923 1.02
tpch_q16/datafusion:parquet 135882435 142632580 0.95
tpch_q17/datafusion:parquet 691863783 684092213 1.01
tpch_q18/datafusion:parquet 901131136 875534420 1.03
tpch_q19/datafusion:parquet 261154145 260465012 1.00
tpch_q20/datafusion:parquet 308064437 301757568 1.02
tpch_q21/datafusion:parquet 732999852 732603750 1.00
tpch_q22/datafusion:parquet 217380655 223107762 0.97
datafusion / arrow (1.002x ➖, 0↑ 1↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 577689370 590931396 0.98
tpch_q02/datafusion:arrow 158687515 159282942 1.00
tpch_q03/datafusion:arrow 438429601 437442206 1.00
tpch_q04/datafusion:arrow 330332296 330883071 1.00
tpch_q05/datafusion:arrow 874374802 872492870 1.00
tpch_q06/datafusion:arrow 257870211 261301966 0.99
tpch_q07/datafusion:arrow 1075592851 1081679762 0.99
tpch_q08/datafusion:arrow 1082172217 1056599192 1.02
tpch_q09/datafusion:arrow 1284672414 1280294259 1.00
tpch_q10/datafusion:arrow 571909612 582425498 0.98
tpch_q11/datafusion:arrow 143768458 146043898 0.98
tpch_q12/datafusion:arrow 🚨 731563751 639689763 1.14
tpch_q13/datafusion:arrow 511569036 499602027 1.02
tpch_q14/datafusion:arrow 289758596 293991204 0.99
tpch_q15/datafusion:arrow 611407487 624170618 0.98
tpch_q16/datafusion:arrow 106290191 106968161 0.99
tpch_q17/datafusion:arrow 1272691485 1283265742 0.99
tpch_q18/datafusion:arrow 1786067477 1769070290 1.01
tpch_q19/datafusion:arrow 475616350 481234397 0.99
tpch_q20/datafusion:arrow 464064732 471268584 0.98
tpch_q21/datafusion:arrow 2766473613 2755911211 1.00
tpch_q22/datafusion:arrow 139626823 140729038 0.99
duckdb / vortex-file-compressed (0.996x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 176918744 178462699 0.99
tpch_q02/duckdb:vortex-file-compressed 52846790 52984791 1.00
tpch_q03/duckdb:vortex-file-compressed 127066965 125524290 1.01
tpch_q04/duckdb:vortex-file-compressed 148641697 149663101 0.99
tpch_q05/duckdb:vortex-file-compressed 129835748 134101604 0.97
tpch_q06/duckdb:vortex-file-compressed 47147617 46718506 1.01
tpch_q07/duckdb:vortex-file-compressed 148365470 147044474 1.01
tpch_q08/duckdb:vortex-file-compressed 175350882 179520809 0.98
tpch_q09/duckdb:vortex-file-compressed 336611305 337191367 1.00
tpch_q10/duckdb:vortex-file-compressed 152947116 154515671 0.99
tpch_q11/duckdb:vortex-file-compressed 35950520 36664293 0.98
tpch_q12/duckdb:vortex-file-compressed 87284720 89769801 0.97
tpch_q13/duckdb:vortex-file-compressed 245101804 246401300 0.99
tpch_q14/duckdb:vortex-file-compressed 70981007 71758006 0.99
tpch_q15/duckdb:vortex-file-compressed 96528553 98586545 0.98
tpch_q16/duckdb:vortex-file-compressed 78352091 78934210 0.99
tpch_q17/duckdb:vortex-file-compressed 102643312 101907634 1.01
tpch_q18/duckdb:vortex-file-compressed 292760371 273248626 1.07
tpch_q19/duckdb:vortex-file-compressed 92075365 90913811 1.01
tpch_q20/duckdb:vortex-file-compressed 164314329 163385944 1.01
tpch_q21/duckdb:vortex-file-compressed 554973026 554001330 1.00
tpch_q22/duckdb:vortex-file-compressed 76738991 78787299 0.97
duckdb / vortex-compact (0.999x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 228462330 229498464 1.00
tpch_q02/duckdb:vortex-compact 57524717 59519243 0.97
tpch_q03/duckdb:vortex-compact 139055721 139826626 0.99
tpch_q04/duckdb:vortex-compact 176330668 175697145 1.00
tpch_q05/duckdb:vortex-compact 147388325 147478267 1.00
tpch_q06/duckdb:vortex-compact 81924664 82914769 0.99
tpch_q07/duckdb:vortex-compact 199726327 201451699 0.99
tpch_q08/duckdb:vortex-compact 190427328 193157278 0.99
tpch_q09/duckdb:vortex-compact 364831610 367879425 0.99
tpch_q10/duckdb:vortex-compact 185304238 182817597 1.01
tpch_q11/duckdb:vortex-compact 41011536 41508490 0.99
tpch_q12/duckdb:vortex-compact 198933952 200119078 0.99
tpch_q13/duckdb:vortex-compact 294754584 291883637 1.01
tpch_q14/duckdb:vortex-compact 102525745 100461852 1.02
tpch_q15/duckdb:vortex-compact 115626245 116772536 0.99
tpch_q16/duckdb:vortex-compact 86218079 86824388 0.99
tpch_q17/duckdb:vortex-compact 116132675 118860676 0.98
tpch_q18/duckdb:vortex-compact 304860984 286424531 1.06
tpch_q19/duckdb:vortex-compact 114461407 112108779 1.02
tpch_q20/duckdb:vortex-compact 205847941 205128573 1.00
tpch_q21/duckdb:vortex-compact 634381294 621782020 1.02
tpch_q22/duckdb:vortex-compact 88096069 89823038 0.98
duckdb / parquet (0.998x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 256146086 254885660 1.00
tpch_q02/duckdb:parquet 104153910 103318551 1.01
tpch_q03/duckdb:parquet 206978256 212858991 0.97
tpch_q04/duckdb:parquet 134946014 134652161 1.00
tpch_q05/duckdb:parquet 219569963 221080336 0.99
tpch_q06/duckdb:parquet 67560519 66973607 1.01
tpch_q07/duckdb:parquet 177646261 179924599 0.99
tpch_q08/duckdb:parquet 256937002 255433888 1.01
tpch_q09/duckdb:parquet 456921722 464950196 0.98
tpch_q10/duckdb:parquet 603175783 606869044 0.99
tpch_q11/duckdb:parquet 40463699 41032410 0.99
tpch_q12/duckdb:parquet 125860790 125427822 1.00
tpch_q13/duckdb:parquet 450392117 464604099 0.97
tpch_q14/duckdb:parquet 173541451 171033130 1.01
tpch_q15/duckdb:parquet 97831415 99784954 0.98
tpch_q16/duckdb:parquet 161461960 159619987 1.01
tpch_q17/duckdb:parquet 178413828 179789936 0.99
tpch_q18/duckdb:parquet 356186592 345227272 1.03
tpch_q19/duckdb:parquet 281055315 288066643 0.98
tpch_q20/duckdb:parquet 232578057 229214906 1.01
tpch_q21/duckdb:parquet 569598843 569399838 1.00
tpch_q22/duckdb:parquet 293699120 289906694 1.01
duckdb / duckdb (1.001x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 118206058 116942833 1.01
tpch_q02/duckdb:duckdb 48326201 49030164 0.99
tpch_q03/duckdb:duckdb 98099755 97372823 1.01
tpch_q04/duckdb:duckdb 130410806 130016357 1.00
tpch_q05/duckdb:duckdb 108332658 107710647 1.01
tpch_q06/duckdb:duckdb 39256468 39308319 1.00
tpch_q07/duckdb:duckdb 85480653 85391966 1.00
tpch_q08/duckdb:duckdb 109726074 109325131 1.00
tpch_q09/duckdb:duckdb 275682918 280301690 0.98
tpch_q10/duckdb:duckdb 200439845 200418675 1.00
tpch_q11/duckdb:duckdb 15571894 15480379 1.01
tpch_q12/duckdb:duckdb 83454573 84212724 0.99
tpch_q13/duckdb:duckdb 249175419 252644267 0.99
tpch_q14/duckdb:duckdb 69509129 70592258 0.98
tpch_q15/duckdb:duckdb 76394147 77948859 0.98
tpch_q16/duckdb:duckdb 73059222 71724564 1.02
tpch_q17/duckdb:duckdb 84387704 84177712 1.00
tpch_q18/duckdb:duckdb 214466738 212559014 1.01
tpch_q19/duckdb:duckdb 116472738 115881886 1.01
tpch_q20/duckdb:duckdb 111409813 111648193 1.00
tpch_q21/duckdb:duckdb 310009094 306692024 1.01
tpch_q22/duckdb:duckdb 69644108 67733422 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -2.2% -1.1% -1.1% +10.8% ➖ noise
1 datafusion:vortex-compact -2.1% -1.1% -1.0% +12.0% ➖ noise
1 datafusion:vortex-file-compressed -0.4% -1.1% +0.8% +12.9% ➖ noise
1 duckdb:duckdb +1.1% -1.1% +2.3% +11.7% ➖ noise
1 duckdb:vortex-compact -0.5% -1.1% +0.7% +10.9% ➖ noise
1 duckdb:vortex-file-compressed -0.9% -1.1% +0.3% +11.1% ➖ noise
2 datafusion:arrow -0.4% +1.5% -1.9% +10.0% ➖ noise
2 datafusion:vortex-compact -2.7% +1.5% -4.1% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +0.8% +1.5% -0.7% +10.3% ➖ noise
2 duckdb:duckdb -1.4% +1.5% -2.9% +12.2% ➖ noise
2 duckdb:vortex-compact -3.4% +1.5% -4.8% +11.7% ➖ noise
2 duckdb:vortex-file-compressed -0.3% +1.5% -1.7% +11.5% ➖ noise
3 datafusion:arrow +0.2% -1.4% +1.6% +10.0% ➖ noise
3 datafusion:vortex-compact +0.2% -1.4% +1.6% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -0.2% -1.4% +1.2% +10.0% ➖ noise
3 duckdb:duckdb +0.7% -1.4% +2.1% +10.0% ➖ noise
3 duckdb:vortex-compact -0.6% -1.4% +0.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +1.2% -1.4% +2.6% +10.0% ➖ noise
4 datafusion:arrow -0.2% +1.3% -1.5% +10.0% ➖ noise
4 datafusion:vortex-compact -1.0% +1.3% -2.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +1.6% +1.3% +0.3% +10.0% ➖ noise
4 duckdb:duckdb +0.3% +1.3% -1.0% +10.0% ➖ noise
4 duckdb:vortex-compact +0.4% +1.3% -0.9% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.7% +1.3% -2.0% +10.0% ➖ noise
5 datafusion:arrow +0.2% -0.1% +0.3% +10.0% ➖ noise
5 datafusion:vortex-compact +0.2% -0.1% +0.3% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +1.5% -0.1% +1.6% +10.0% ➖ noise
5 duckdb:duckdb +0.6% -0.1% +0.7% +10.0% ➖ noise
5 duckdb:vortex-compact -0.1% -0.1% +0.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -3.2% -0.1% -3.1% +10.0% ➖ noise
6 datafusion:arrow -1.3% +2.9% -4.1% +10.0% ➖ noise
6 datafusion:vortex-compact +0.6% +2.9% -2.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +0.9% +2.9% -2.0% +10.0% ➖ noise
6 duckdb:duckdb -0.1% +2.9% -3.0% +16.5% ➖ noise
6 duckdb:vortex-compact -1.2% +2.9% -4.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.9% +2.9% -2.0% +12.7% ➖ noise
7 datafusion:arrow -0.6% -0.5% -0.1% +10.0% ➖ noise
7 datafusion:vortex-compact -1.3% -0.5% -0.8% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +0.6% -0.5% +1.1% +10.0% ➖ noise
7 duckdb:duckdb +0.1% -0.5% +0.6% +11.2% ➖ noise
7 duckdb:vortex-compact -0.9% -0.5% -0.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +0.9% -0.5% +1.4% +10.0% ➖ noise
8 datafusion:arrow +2.4% +0.6% +1.8% +10.0% ➖ noise
8 datafusion:vortex-compact -2.0% +0.6% -2.6% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +2.1% +0.6% +1.5% +10.0% ➖ noise
8 duckdb:duckdb +0.4% +0.6% -0.2% +10.0% ➖ noise
8 duckdb:vortex-compact -1.4% +0.6% -2.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -2.3% +0.6% -2.9% +10.0% ➖ noise
9 datafusion:arrow +0.3% +0.5% -0.1% +10.0% ➖ noise
9 datafusion:vortex-compact +0.7% +0.5% +0.2% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +2.0% +0.5% +1.5% +10.0% ➖ noise
9 duckdb:duckdb -1.6% +0.5% -2.1% +10.0% ➖ noise
9 duckdb:vortex-compact -0.8% +0.5% -1.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.2% +0.5% -0.6% +10.0% ➖ noise
10 datafusion:arrow -1.8% -0.8% -1.0% +10.0% ➖ noise
10 datafusion:vortex-compact -3.1% -0.8% -2.3% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +2.0% -0.8% +2.8% +10.0% ➖ noise
10 duckdb:duckdb +0.0% -0.8% +0.8% +10.0% ➖ noise
10 duckdb:vortex-compact +1.4% -0.8% +2.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.0% -0.8% -0.2% +10.0% ➖ noise
11 datafusion:arrow -1.6% +0.0% -1.6% +10.0% ➖ noise
11 datafusion:vortex-compact -0.5% +0.0% -0.6% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -0.5% +0.0% -0.5% +10.0% ➖ noise
11 duckdb:duckdb +0.6% +0.0% +0.6% +17.1% ➖ noise
11 duckdb:vortex-compact -1.2% +0.0% -1.2% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -1.9% +0.0% -2.0% +10.0% ➖ noise
12 datafusion:arrow +14.4% -2.6% +17.4% +44.3% ➖ noise
12 datafusion:vortex-compact +0.1% -2.6% +2.7% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -0.8% -2.6% +1.9% +10.0% ➖ noise
12 duckdb:duckdb -0.9% -2.6% +1.7% +10.0% ➖ noise
12 duckdb:vortex-compact -0.6% -2.6% +2.1% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -2.8% -2.6% -0.2% +10.0% ➖ noise
13 datafusion:arrow +2.4% -0.5% +2.9% +11.8% ➖ noise
13 datafusion:vortex-compact +0.1% -0.5% +0.6% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +0.3% -0.5% +0.8% +10.0% ➖ noise
13 duckdb:duckdb -1.4% -0.5% -0.9% +10.0% ➖ noise
13 duckdb:vortex-compact +1.0% -0.5% +1.5% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -0.5% -0.5% -0.0% +10.0% ➖ noise
14 datafusion:arrow -1.4% +4.3% -5.5% +10.0% ➖ noise
14 datafusion:vortex-compact +1.2% +4.3% -3.0% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +5.1% +4.3% +0.8% +12.5% ➖ noise
14 duckdb:duckdb -1.5% +4.3% -5.6% +10.0% ➖ noise
14 duckdb:vortex-compact +2.1% +4.3% -2.2% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -1.1% +4.3% -5.2% +10.0% ➖ noise
15 datafusion:arrow -2.0% +0.0% -2.1% +10.0% ➖ noise
15 datafusion:vortex-compact -3.1% +0.0% -3.1% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +2.1% +0.0% +2.1% +10.0% ➖ noise
15 duckdb:duckdb -2.0% +0.0% -2.0% +10.0% ➖ noise
15 duckdb:vortex-compact -1.0% +0.0% -1.0% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -2.1% +0.0% -2.1% +10.0% ➖ noise
16 datafusion:arrow -0.6% -1.8% +1.2% +10.0% ➖ noise
16 datafusion:vortex-compact -0.4% -1.8% +1.5% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -0.9% -1.8% +1.0% +10.0% ➖ noise
16 duckdb:duckdb +1.9% -1.8% +3.8% +10.0% ➖ noise
16 duckdb:vortex-compact -0.7% -1.8% +1.2% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -0.7% -1.8% +1.1% +10.0% ➖ noise
17 datafusion:arrow -0.8% +0.2% -1.0% +10.0% ➖ noise
17 datafusion:vortex-compact -0.0% +0.2% -0.2% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +1.8% +0.2% +1.6% +10.0% ➖ noise
17 duckdb:duckdb +0.2% +0.2% +0.1% +10.0% ➖ noise
17 duckdb:vortex-compact -2.3% +0.2% -2.5% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +0.7% +0.2% +0.5% +10.0% ➖ noise
18 datafusion:arrow +1.0% +3.0% -2.0% +10.0% ➖ noise
18 datafusion:vortex-compact -2.9% +3.0% -5.8% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -0.3% +3.0% -3.2% +10.0% ➖ noise
18 duckdb:duckdb +0.9% +3.0% -2.1% +10.0% ➖ noise
18 duckdb:vortex-compact +6.4% +3.0% +3.3% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +7.1% +3.0% +4.0% +10.0% ➖ noise
19 datafusion:arrow -1.2% -1.1% -0.1% +10.0% ➖ noise
19 datafusion:vortex-compact -3.9% -1.1% -2.9% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -4.3% -1.1% -3.2% +10.0% ➖ noise
19 duckdb:duckdb +0.5% -1.1% +1.6% +10.0% ➖ noise
19 duckdb:vortex-compact +2.1% -1.1% +3.2% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +1.3% -1.1% +2.4% +10.0% ➖ noise
20 datafusion:arrow -1.5% +1.8% -3.2% +10.0% ➖ noise
20 datafusion:vortex-compact -2.8% +1.8% -4.5% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -2.0% +1.8% -3.7% +10.0% ➖ noise
20 duckdb:duckdb -0.2% +1.8% -2.0% +10.0% ➖ noise
20 duckdb:vortex-compact +0.4% +1.8% -1.4% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +0.6% +1.8% -1.2% +10.0% ➖ noise
21 datafusion:arrow +0.4% +0.0% +0.3% +10.0% ➖ noise
21 datafusion:vortex-compact -2.2% +0.0% -2.2% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +1.0% +0.0% +0.9% +10.0% ➖ noise
21 duckdb:duckdb +1.1% +0.0% +1.0% +10.0% ➖ noise
21 duckdb:vortex-compact +2.0% +0.0% +2.0% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +0.2% +0.0% +0.1% +10.0% ➖ noise
22 datafusion:arrow -0.8% -0.6% -0.1% +10.0% ➖ noise
22 datafusion:vortex-compact -1.5% -0.6% -0.8% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -2.0% -0.6% -1.4% +10.0% ➖ noise
22 duckdb:duckdb +2.8% -0.6% +3.5% +11.7% ➖ noise
22 duckdb:vortex-compact -1.9% -0.6% -1.3% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -2.6% -0.6% -2.0% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.2%
Vortex (geomean): 0.947x ➖
Parquet (geomean): 0.959x ➖
Shifts: Parquet (control) -4.1% · Median polish -3.7%


duckdb / vortex-file-compressed (0.928x ➖, 1↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 10649462 11693144 0.91
statpopgen_q01/duckdb:vortex-file-compressed 🚀 19084400 29435444 0.65
statpopgen_q02/duckdb:vortex-file-compressed 1286731899 1355900258 0.95
statpopgen_q03/duckdb:vortex-file-compressed 3075863702 3142845588 0.98
statpopgen_q04/duckdb:vortex-file-compressed 3088479503 3136617183 0.98
statpopgen_q05/duckdb:vortex-file-compressed 1400785295 1415581849 0.99
statpopgen_q06/duckdb:vortex-file-compressed 2053642483 2100886057 0.98
statpopgen_q07/duckdb:vortex-file-compressed 220341588 227933112 0.97
statpopgen_q08/duckdb:vortex-file-compressed 238421545 249206660 0.96
statpopgen_q09/duckdb:vortex-file-compressed 2821080814 3027890391 0.93
statpopgen_q10/duckdb:vortex-file-compressed 4582788892 4715835195 0.97
duckdb / vortex-compact (0.967x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10674952 11496902 0.93
statpopgen_q01/duckdb:vortex-compact 172264065 181744737 0.95
statpopgen_q02/duckdb:vortex-compact 1805255819 1853562512 0.97
statpopgen_q03/duckdb:vortex-compact 3453003415 3567592454 0.97
statpopgen_q04/duckdb:vortex-compact 3514932725 3667436540 0.96
statpopgen_q05/duckdb:vortex-compact 1803915076 1868397501 0.97
statpopgen_q06/duckdb:vortex-compact 2665448957 2728120882 0.98
statpopgen_q07/duckdb:vortex-compact 928618629 941307517 0.99
statpopgen_q08/duckdb:vortex-compact 964809148 988590449 0.98
statpopgen_q09/duckdb:vortex-compact 3336446015 3389339456 0.98
statpopgen_q10/duckdb:vortex-compact 5394994619 5547077866 0.97
duckdb / parquet (0.959x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 307708302 326175516 0.94
statpopgen_q01/duckdb:parquet 393383475 412578436 0.95
statpopgen_q02/duckdb:parquet 992421417 1030622473 0.96
statpopgen_q03/duckdb:parquet 1498987581 1525265824 0.98
statpopgen_q04/duckdb:parquet 1471607678 1553924834 0.95
statpopgen_q05/duckdb:parquet 1004969202 1051101296 0.96
statpopgen_q06/duckdb:parquet 1483156155 1526155732 0.97
statpopgen_q07/duckdb:parquet 1895156964 1961412217 0.97
statpopgen_q08/duckdb:parquet 1852362748 1956713923 0.95
statpopgen_q09/duckdb:parquet 1375077910 1455225651 0.94
statpopgen_q10/duckdb:parquet 2670146643 2751595866 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -7.1% -5.7% -1.6% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -8.9% -5.7% -3.5% +10.0% ➖ noise
1 duckdb:vortex-compact -5.2% -4.7% -0.6% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -35.2% -4.7% -32.0% +227.1% ➖ noise
2 duckdb:vortex-compact -2.6% -3.7% +1.1% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -5.1% -3.7% -1.4% +10.0% ➖ noise
3 duckdb:vortex-compact -3.2% -1.7% -1.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -2.1% -1.7% -0.4% +10.0% ➖ noise
4 duckdb:vortex-compact -4.2% -5.3% +1.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.5% -5.3% +4.0% +10.0% ➖ noise
5 duckdb:vortex-compact -3.5% -4.4% +1.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.0% -4.4% +3.5% +10.0% ➖ noise
6 duckdb:vortex-compact -2.3% -2.8% +0.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -2.2% -2.8% +0.6% +10.0% ➖ noise
7 duckdb:vortex-compact -1.3% -3.4% +2.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -3.3% -3.4% +0.0% +10.0% ➖ noise
8 duckdb:vortex-compact -2.4% -5.3% +3.1% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -4.3% -5.3% +1.1% +10.0% ➖ noise
9 duckdb:vortex-compact -1.6% -5.5% +4.2% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -6.8% -5.5% -1.4% +10.0% ➖ noise
10 duckdb:vortex-compact -2.7% -3.0% +0.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -2.8% -3.0% +0.1% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.4%
Vortex (geomean): 1.016x ➖
Parquet (geomean): 1.004x ➖
Shifts: Parquet (control) +0.4% · Median polish +0.4%


datafusion / vortex-file-compressed (1.007x ➖, 0↑ 1↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1896541 1866690 1.02
clickbench_q01/datafusion:vortex-file-compressed 13934387 14032904 0.99
clickbench_q02/datafusion:vortex-file-compressed 34556491 33688387 1.03
clickbench_q03/datafusion:vortex-file-compressed 39657252 37673772 1.05
clickbench_q04/datafusion:vortex-file-compressed 301092795 306138462 0.98
clickbench_q05/datafusion:vortex-file-compressed 327669837 319445994 1.03
clickbench_q06/datafusion:vortex-file-compressed 1963410 2065633 0.95
clickbench_q07/datafusion:vortex-file-compressed 18321888 17441167 1.05
clickbench_q08/datafusion:vortex-file-compressed 384889033 381255857 1.01
clickbench_q09/datafusion:vortex-file-compressed 571421306 561743822 1.02
clickbench_q10/datafusion:vortex-file-compressed 72249737 72602796 1.00
clickbench_q11/datafusion:vortex-file-compressed 83066848 83482191 1.00
clickbench_q12/datafusion:vortex-file-compressed 276200285 274391725 1.01
clickbench_q13/datafusion:vortex-file-compressed 417261278 407505086 1.02
clickbench_q14/datafusion:vortex-file-compressed 257491579 256827771 1.00
clickbench_q15/datafusion:vortex-file-compressed 360238765 354000280 1.02
clickbench_q16/datafusion:vortex-file-compressed 701768265 690159839 1.02
clickbench_q17/datafusion:vortex-file-compressed 691219175 681043967 1.01
clickbench_q18/datafusion:vortex-file-compressed 1334608065 1319272598 1.01
clickbench_q19/datafusion:vortex-file-compressed 24117703 25023070 0.96
clickbench_q20/datafusion:vortex-file-compressed 360176984 358092252 1.01
clickbench_q21/datafusion:vortex-file-compressed 400892967 404010662 0.99
clickbench_q22/datafusion:vortex-file-compressed 486068660 490703672 0.99
clickbench_q23/datafusion:vortex-file-compressed 635909066 680870927 0.93
clickbench_q24/datafusion:vortex-file-compressed 50381210 51009867 0.99
clickbench_q25/datafusion:vortex-file-compressed 70097531 68673597 1.02
clickbench_q26/datafusion:vortex-file-compressed 49377672 46073746 1.07
clickbench_q27/datafusion:vortex-file-compressed 804266290 826245916 0.97
clickbench_q28/datafusion:vortex-file-compressed 6772718418 6990549201 0.97
clickbench_q29/datafusion:vortex-file-compressed 242658525 234095106 1.04
clickbench_q30/datafusion:vortex-file-compressed 227397400 228746221 0.99
clickbench_q31/datafusion:vortex-file-compressed 266597670 265818460 1.00
clickbench_q32/datafusion:vortex-file-compressed 1312260625 1199179243 1.09
clickbench_q33/datafusion:vortex-file-compressed 1411200058 1437797916 0.98
clickbench_q34/datafusion:vortex-file-compressed 1405966794 1425872583 0.99
clickbench_q35/datafusion:vortex-file-compressed 517840173 521736848 0.99
clickbench_q36/datafusion:vortex-file-compressed 78734463 80657934 0.98
clickbench_q37/datafusion:vortex-file-compressed 39016425 40096386 0.97
clickbench_q38/datafusion:vortex-file-compressed 23100065 21561800 1.07
clickbench_q39/datafusion:vortex-file-compressed 142277527 153312892 0.93
clickbench_q40/datafusion:vortex-file-compressed 🚨 20180077 17671885 1.14
clickbench_q41/datafusion:vortex-file-compressed 17674084 16937871 1.04
clickbench_q42/datafusion:vortex-file-compressed 18847725 18683356 1.01
datafusion / parquet (0.999x ➖, 1↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1842907 1746560 1.06
clickbench_q01/datafusion:parquet 21887385 20439646 1.07
clickbench_q02/datafusion:parquet 56876011 55595709 1.02
clickbench_q03/datafusion:parquet 47241445 44505396 1.06
clickbench_q04/datafusion:parquet 328954997 338010369 0.97
clickbench_q05/datafusion:parquet 371490680 371959614 1.00
clickbench_q06/datafusion:parquet 1808200 1772991 1.02
clickbench_q07/datafusion:parquet 26008321 26264033 0.99
clickbench_q08/datafusion:parquet 414029942 414998550 1.00
clickbench_q09/datafusion:parquet 638715373 659595919 0.97
clickbench_q10/datafusion:parquet 115487002 110200710 1.05
clickbench_q11/datafusion:parquet 139311693 134894348 1.03
clickbench_q12/datafusion:parquet 358860986 374898261 0.96
clickbench_q13/datafusion:parquet 507129394 508697861 1.00
clickbench_q14/datafusion:parquet 363352629 356940149 1.02
clickbench_q15/datafusion:parquet 377702584 378106532 1.00
clickbench_q16/datafusion:parquet 728944266 719514528 1.01
clickbench_q17/datafusion:parquet 698623908 694003495 1.01
clickbench_q18/datafusion:parquet 1394339130 1417434145 0.98
clickbench_q19/datafusion:parquet 33081617 34886929 0.95
clickbench_q20/datafusion:parquet 614708392 633633682 0.97
clickbench_q21/datafusion:parquet 678142340 673785182 1.01
clickbench_q22/datafusion:parquet 995561980 997549406 1.00
clickbench_q23/datafusion:parquet 3683031131 3706623298 0.99
clickbench_q24/datafusion:parquet 89729682 90335354 0.99
clickbench_q25/datafusion:parquet 140295803 141298426 0.99
clickbench_q26/datafusion:parquet 92475276 87604016 1.06
clickbench_q27/datafusion:parquet 1067242661 1075080551 0.99
clickbench_q28/datafusion:parquet 6597100793 6561081569 1.01
clickbench_q29/datafusion:parquet 243429978 238500638 1.02
clickbench_q30/datafusion:parquet 362029664 364233642 0.99
clickbench_q31/datafusion:parquet 399223164 393002106 1.02
clickbench_q32/datafusion:parquet 🚀 1181121261 1321605868 0.89
clickbench_q33/datafusion:parquet 1528885530 1629988199 0.94
clickbench_q34/datafusion:parquet 1534775253 1537289839 1.00
clickbench_q35/datafusion:parquet 540158970 537388230 1.01
clickbench_q36/datafusion:parquet 148408025 144176663 1.03
clickbench_q37/datafusion:parquet 61313571 62221598 0.99
clickbench_q38/datafusion:parquet 89245700 95466022 0.93
clickbench_q39/datafusion:parquet 270916029 281313830 0.96
clickbench_q40/datafusion:parquet 33558222 33170625 1.01
clickbench_q41/datafusion:parquet 30333084 30598968 0.99
clickbench_q42/datafusion:parquet 31060754 30440232 1.02
duckdb / vortex-file-compressed (1.025x ➖, 1↑ 5↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6317953 5933655 1.06
clickbench_q01/duckdb:vortex-file-compressed 13379219 14088204 0.95
clickbench_q02/duckdb:vortex-file-compressed 26393202 25363453 1.04
clickbench_q03/duckdb:vortex-file-compressed 30267351 29175595 1.04
clickbench_q04/duckdb:vortex-file-compressed 185374811 179439474 1.03
clickbench_q05/duckdb:vortex-file-compressed 198448851 198434475 1.00
clickbench_q06/duckdb:vortex-file-compressed 18756303 17962982 1.04
clickbench_q07/duckdb:vortex-file-compressed 15079349 14373385 1.05
clickbench_q08/duckdb:vortex-file-compressed 273418579 268421045 1.02
clickbench_q09/duckdb:vortex-file-compressed 364306155 350699403 1.04
clickbench_q10/duckdb:vortex-file-compressed 71731561 73156243 0.98
clickbench_q11/duckdb:vortex-file-compressed 80925444 80666059 1.00
clickbench_q12/duckdb:vortex-file-compressed 219018188 216570343 1.01
clickbench_q13/duckdb:vortex-file-compressed 449891593 425328981 1.06
clickbench_q14/duckdb:vortex-file-compressed 244367134 245309843 1.00
clickbench_q15/duckdb:vortex-file-compressed 221301706 221707247 1.00
clickbench_q16/duckdb:vortex-file-compressed 710618836 696696620 1.02
clickbench_q17/duckdb:vortex-file-compressed 562512188 523418174 1.07
clickbench_q18/duckdb:vortex-file-compressed 1222201104 1191310457 1.03
clickbench_q19/duckdb:vortex-file-compressed 21379469 20834718 1.03
clickbench_q20/duckdb:vortex-file-compressed 400004735 373371227 1.07
clickbench_q21/duckdb:vortex-file-compressed 421326356 411227557 1.02
clickbench_q22/duckdb:vortex-file-compressed 654671958 695536833 0.94
clickbench_q23/duckdb:vortex-file-compressed 🚀 823512970 1886996724 0.44
clickbench_q24/duckdb:vortex-file-compressed 🚨 46073319 39198571 1.18
clickbench_q25/duckdb:vortex-file-compressed 82427464 76624444 1.08
clickbench_q26/duckdb:vortex-file-compressed 🚨 54226303 38059425 1.42
clickbench_q27/duckdb:vortex-file-compressed 490684106 498241643 0.98
clickbench_q28/duckdb:vortex-file-compressed 3016420544 2989177210 1.01
clickbench_q29/duckdb:vortex-file-compressed 29208936 28773210 1.02
clickbench_q30/duckdb:vortex-file-compressed 181352300 182685923 0.99
clickbench_q31/duckdb:vortex-file-compressed 261788922 260015772 1.01
clickbench_q32/duckdb:vortex-file-compressed 1427079416 1381971022 1.03
clickbench_q33/duckdb:vortex-file-compressed 1661031979 1565120109 1.06
clickbench_q34/duckdb:vortex-file-compressed 1736883654 1603069964 1.08
clickbench_q35/duckdb:vortex-file-compressed 369701440 376503833 0.98
clickbench_q36/duckdb:vortex-file-compressed 33487570 30536019 1.10
clickbench_q37/duckdb:vortex-file-compressed 🚨 26121352 22954348 1.14
clickbench_q38/duckdb:vortex-file-compressed 26707066 25104749 1.06
clickbench_q39/duckdb:vortex-file-compressed 44631403 41576621 1.07
clickbench_q40/duckdb:vortex-file-compressed 25015405 24464628 1.02
clickbench_q41/duckdb:vortex-file-compressed 🚨 24176610 21641135 1.12
clickbench_q42/duckdb:vortex-file-compressed 🚨 26294567 22504108 1.17
duckdb / parquet (1.008x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 225303408 222107105 1.01
clickbench_q01/duckdb:parquet 50565025 50424588 1.00
clickbench_q02/duckdb:parquet 66380406 66073475 1.00
clickbench_q03/duckdb:parquet 64523576 63575950 1.01
clickbench_q04/duckdb:parquet 207194902 206891325 1.00
clickbench_q05/duckdb:parquet 281507418 275929840 1.02
clickbench_q06/duckdb:parquet 61639953 59825216 1.03
clickbench_q07/duckdb:parquet 53784868 51438922 1.05
clickbench_q08/duckdb:parquet 267840023 267756126 1.00
clickbench_q09/duckdb:parquet 403198780 396736762 1.02
clickbench_q10/duckdb:parquet 96659825 98081362 0.99
clickbench_q11/duckdb:parquet 109109819 107572871 1.01
clickbench_q12/duckdb:parquet 295578654 295482993 1.00
clickbench_q13/duckdb:parquet 520330028 522642932 1.00
clickbench_q14/duckdb:parquet 330717355 331314556 1.00
clickbench_q15/duckdb:parquet 246972860 244245995 1.01
clickbench_q16/duckdb:parquet 612130553 619531911 0.99
clickbench_q17/duckdb:parquet 507696634 510754948 0.99
clickbench_q18/duckdb:parquet 1059107508 1057611304 1.00
clickbench_q19/duckdb:parquet 50014608 49090020 1.02
clickbench_q20/duckdb:parquet 433465173 436287199 0.99
clickbench_q21/duckdb:parquet 560130260 556202044 1.01
clickbench_q22/duckdb:parquet 938272082 942463720 1.00
clickbench_q23/duckdb:parquet 317991650 310555761 1.02
clickbench_q24/duckdb:parquet 80379373 78654203 1.02
clickbench_q25/duckdb:parquet 140848627 140070062 1.01
clickbench_q26/duckdb:parquet 53948614 51395949 1.05
clickbench_q27/duckdb:parquet 646569909 641917787 1.01
clickbench_q28/duckdb:parquet 4872671834 4840616590 1.01
clickbench_q29/duckdb:parquet 61842734 61913442 1.00
clickbench_q30/duckdb:parquet 308035175 302657402 1.02
clickbench_q31/duckdb:parquet 352250516 342795866 1.03
clickbench_q32/duckdb:parquet 1172285921 1176813775 1.00
clickbench_q33/duckdb:parquet 1280761078 1282166355 1.00
clickbench_q34/duckdb:parquet 1360907385 1264374176 1.08
clickbench_q35/duckdb:parquet 355920608 352947229 1.01
clickbench_q36/duckdb:parquet 64718375 66435582 0.97
clickbench_q37/duckdb:parquet 53551413 54434025 0.98
clickbench_q38/duckdb:parquet 59073044 58460677 1.01
clickbench_q39/duckdb:parquet 97815767 98744979 0.99
clickbench_q40/duckdb:parquet 56064908 56806157 0.99
clickbench_q41/duckdb:parquet 59631832 59306165 1.01
clickbench_q42/duckdb:parquet 53701313 52460431 1.02
duckdb / duckdb (1.021x ➖, 0↑ 4↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17447677 17667636 0.99
clickbench_q01/duckdb:duckdb 33152753 32376904 1.02
clickbench_q02/duckdb:duckdb 45096061 44987965 1.00
clickbench_q03/duckdb:duckdb 46076203 46350627 0.99
clickbench_q04/duckdb:duckdb 234995676 228659834 1.03
clickbench_q05/duckdb:duckdb 341086660 319745556 1.07
clickbench_q06/duckdb:duckdb 35326411 34470116 1.02
clickbench_q07/duckdb:duckdb 35410107 35121295 1.01
clickbench_q08/duckdb:duckdb 🚨 352199111 310471258 1.13
clickbench_q09/duckdb:duckdb 477800777 494602879 0.97
clickbench_q10/duckdb:duckdb 98018138 97553045 1.00
clickbench_q11/duckdb:duckdb 107631837 107219365 1.00
clickbench_q12/duckdb:duckdb 324467115 306078614 1.06
clickbench_q13/duckdb:duckdb 567697221 526683423 1.08
clickbench_q14/duckdb:duckdb 377300697 351921989 1.07
clickbench_q15/duckdb:duckdb 282522497 270310664 1.05
clickbench_q16/duckdb:duckdb 705949358 692079701 1.02
clickbench_q17/duckdb:duckdb 604783705 587726521 1.03
clickbench_q18/duckdb:duckdb 1291487192 1264355899 1.02
clickbench_q19/duckdb:duckdb 34777281 34896819 1.00
clickbench_q20/duckdb:duckdb 974716870 974837635 1.00
clickbench_q21/duckdb:duckdb 🚨 1115718726 954990127 1.17
clickbench_q22/duckdb:duckdb 1078989816 999363199 1.08
clickbench_q23/duckdb:duckdb 265074718 261496630 1.01
clickbench_q24/duckdb:duckdb 59880401 60994795 0.98
clickbench_q25/duckdb:duckdb 121930310 123004111 0.99
clickbench_q26/duckdb:duckdb 🚨 55952861 50596972 1.11
clickbench_q27/duckdb:duckdb 1056254218 1155501831 0.91
clickbench_q28/duckdb:duckdb 4628524996 4672717501 0.99
clickbench_q29/duckdb:duckdb 48476860 48315638 1.00
clickbench_q30/duckdb:duckdb 297494448 296531418 1.00
clickbench_q31/duckdb:duckdb 434300310 428286791 1.01
clickbench_q32/duckdb:duckdb 1540575571 1479255325 1.04
clickbench_q33/duckdb:duckdb 1907850915 2013947366 0.95
clickbench_q34/duckdb:duckdb 2032455055 2084096906 0.98
clickbench_q35/duckdb:duckdb 265244977 264918540 1.00
clickbench_q36/duckdb:duckdb 40992009 41627701 0.98
clickbench_q37/duckdb:duckdb 31413032 31886598 0.99
clickbench_q38/duckdb:duckdb 30903186 31250000 0.99
clickbench_q39/duckdb:duckdb 🚨 82555186 65815890 1.25
clickbench_q40/duckdb:duckdb 31282138 31658245 0.99
clickbench_q41/duckdb:duckdb 29933382 29979115 1.00
clickbench_q42/duckdb:duckdb 31537682 31829957 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +1.6% +3.5% -1.8% +560.2% ➖ noise
0 duckdb:duckdb -1.2% +3.5% -4.5% +256.5% ➖ noise
0 duckdb:vortex-file-compressed +6.5% +3.5% +2.9% +302.5% ➖ noise
1 datafusion:vortex-file-compressed -0.7% +3.6% -4.2% +43.8% ➖ noise
1 duckdb:duckdb +2.4% +3.6% -1.2% +55.5% ➖ noise
1 duckdb:vortex-file-compressed -5.0% +3.6% -8.4% +13.8% ➖ noise
2 datafusion:vortex-file-compressed +2.6% +1.4% +1.2% +26.8% ➖ noise
2 duckdb:duckdb +0.2% +1.4% -1.1% +21.6% ➖ noise
2 duckdb:vortex-file-compressed +4.1% +1.4% +2.6% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +5.3% +3.8% +1.4% +161.9% ➖ noise
3 duckdb:duckdb -0.6% +3.8% -4.2% +44.3% ➖ noise
3 duckdb:vortex-file-compressed +3.7% +3.8% -0.0% +12.4% ➖ noise
4 datafusion:vortex-file-compressed -1.6% -1.3% -0.4% +10.0% ➖ noise
4 duckdb:duckdb +2.8% -1.3% +4.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +3.3% -1.3% +4.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +2.6% +0.9% +1.6% +10.0% ➖ noise
5 duckdb:duckdb +6.7% +0.9% +5.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.0% +0.9% -0.9% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -4.9% +2.5% -7.3% +43.5% ➖ noise
6 duckdb:duckdb +2.5% +2.5% -0.0% +28.4% ➖ noise
6 duckdb:vortex-file-compressed +4.4% +2.5% +1.9% +19.0% ➖ noise
7 datafusion:vortex-file-compressed +5.0% +1.8% +3.2% +12.1% ➖ noise
7 duckdb:duckdb +0.8% +1.8% -0.9% +10.5% ➖ noise
7 duckdb:vortex-file-compressed +4.9% +1.8% +3.1% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +1.0% -0.1% +1.1% +10.0% ➖ noise
8 duckdb:duckdb +13.4% -0.1% +13.6% +10.0% 🚨 regression
8 duckdb:vortex-file-compressed +1.9% -0.1% +2.0% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +1.7% -0.8% +2.5% +10.0% ➖ noise
9 duckdb:duckdb -3.4% -0.8% -2.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +3.9% -0.8% +4.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -0.5% +1.6% -2.1% +21.2% ➖ noise
10 duckdb:duckdb +0.5% +1.6% -1.1% +17.1% ➖ noise
10 duckdb:vortex-file-compressed -1.9% +1.6% -3.5% +17.5% ➖ noise
11 datafusion:vortex-file-compressed -0.5% +2.3% -2.8% +10.0% ➖ noise
11 duckdb:duckdb +0.4% +2.3% -1.9% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +0.3% +2.3% -2.0% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +0.7% -2.1% +2.9% +10.0% ➖ noise
12 duckdb:duckdb +6.0% -2.1% +8.3% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +1.1% -2.1% +3.3% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +2.4% -0.4% +2.8% +10.0% ➖ noise
13 duckdb:duckdb +7.8% -0.4% +8.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +5.8% -0.4% +6.2% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +0.3% +0.8% -0.5% +10.0% ➖ noise
14 duckdb:duckdb +7.2% +0.8% +6.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -0.4% +0.8% -1.2% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +1.8% +0.5% +1.3% +10.0% ➖ noise
15 duckdb:duckdb +4.5% +0.5% +4.0% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.2% +0.5% -0.7% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +1.7% +0.1% +1.6% +10.0% ➖ noise
16 duckdb:duckdb +2.0% +0.1% +2.0% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +2.0% +0.1% +1.9% +18.7% ➖ noise
17 datafusion:vortex-file-compressed +1.5% +0.0% +1.5% +10.0% ➖ noise
17 duckdb:duckdb +2.9% +0.0% +2.9% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +7.5% +0.0% +7.4% +13.8% ➖ noise
18 datafusion:vortex-file-compressed +1.2% -0.7% +1.9% +10.0% ➖ noise
18 duckdb:duckdb +2.1% -0.7% +2.9% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +2.6% -0.7% +3.4% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -3.6% -1.7% -1.9% +15.0% ➖ noise
19 duckdb:duckdb -0.3% -1.7% +1.4% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +2.6% -1.7% +4.4% +30.1% ➖ noise
20 datafusion:vortex-file-compressed +0.6% -1.8% +2.5% +197.0% ➖ noise
20 duckdb:duckdb -0.0% -1.8% +1.8% +27.5% ➖ noise
20 duckdb:vortex-file-compressed +7.1% -1.8% +9.1% +10.3% ➖ noise
21 datafusion:vortex-file-compressed -0.8% +0.7% -1.4% +10.0% ➖ noise
21 duckdb:duckdb +16.8% +0.7% +16.0% +10.0% 🚨 regression
21 duckdb:vortex-file-compressed +2.5% +0.7% +1.8% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -0.9% -0.3% -0.6% +10.0% ➖ noise
22 duckdb:duckdb +8.0% -0.3% +8.3% +10.3% ➖ noise
22 duckdb:vortex-file-compressed -5.9% -0.3% -5.6% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -6.6% +0.9% -7.4% +50.7% ➖ noise
23 duckdb:duckdb +1.4% +0.9% +0.5% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -56.4% +0.9% -56.7% +44.7% ✅ faster
24 datafusion:vortex-file-compressed -1.2% +0.8% -2.0% +24.1% ➖ noise
24 duckdb:duckdb -1.8% +0.8% -2.6% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +17.5% +0.8% +16.7% +47.8% ➖ noise
25 datafusion:vortex-file-compressed +2.1% -0.1% +2.2% +10.0% ➖ noise
25 duckdb:duckdb -0.9% -0.1% -0.8% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +7.6% -0.1% +7.7% +15.5% ➖ noise
26 datafusion:vortex-file-compressed +7.2% +5.3% +1.8% +13.6% ➖ noise
26 duckdb:duckdb +10.6% +5.3% +5.1% +15.0% ➖ noise
26 duckdb:vortex-file-compressed +42.5% +5.3% +35.4% +27.8% 🚨 regression
27 datafusion:vortex-file-compressed -2.7% -0.0% -2.7% +10.0% ➖ noise
27 duckdb:duckdb -8.6% -0.0% -8.6% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -1.5% -0.0% -1.5% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -3.1% +0.6% -3.7% +10.4% ➖ noise
28 duckdb:duckdb -0.9% +0.6% -1.5% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +0.9% +0.6% +0.3% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +3.7% +1.0% +2.7% +10.0% ➖ noise
29 duckdb:duckdb +0.3% +1.0% -0.6% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +1.5% +1.0% +0.5% +13.8% ➖ noise
30 datafusion:vortex-file-compressed -0.6% +0.6% -1.2% +10.0% ➖ noise
30 duckdb:duckdb +0.3% +0.6% -0.3% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -0.7% +0.6% -1.3% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +0.3% +2.2% -1.8% +10.0% ➖ noise
31 duckdb:duckdb +1.4% +2.2% -0.7% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +0.7% +2.2% -1.5% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +9.4% -5.6% +16.0% +13.4% 🚨 regression
32 duckdb:duckdb +4.1% -5.6% +10.4% +10.0% 🚨 regression
32 duckdb:vortex-file-compressed +3.3% -5.6% +9.4% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -1.8% -3.2% +1.4% +10.0% ➖ noise
33 duckdb:duckdb -5.3% -3.2% -2.1% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +6.1% -3.2% +9.6% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -1.4% +3.7% -4.9% +10.0% ➖ noise
34 duckdb:duckdb -2.5% +3.7% -5.9% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +8.3% +3.7% +4.5% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -0.7% +0.7% -1.4% +10.0% ➖ noise
35 duckdb:duckdb +0.1% +0.7% -0.6% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -1.8% +0.7% -2.5% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -2.4% +0.1% -2.5% +10.0% ➖ noise
36 duckdb:duckdb -1.5% +0.1% -1.7% +14.8% ➖ noise
36 duckdb:vortex-file-compressed +9.7% +0.1% +9.5% +11.0% ➖ noise
37 datafusion:vortex-file-compressed -2.7% -1.5% -1.2% +10.0% ➖ noise
37 duckdb:duckdb -1.5% -1.5% +0.1% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +13.8% -1.5% +15.6% +10.0% 🚨 regression
38 datafusion:vortex-file-compressed +7.1% -2.8% +10.2% +10.0% 🚨 regression
38 duckdb:duckdb -1.1% -2.8% +1.7% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +6.4% -2.8% +9.5% +10.0% ➖ noise
39 datafusion:vortex-file-compressed -7.2% -2.3% -5.0% +10.4% ➖ noise
39 duckdb:duckdb +25.4% -2.3% +28.4% +15.9% 🚨 regression
39 duckdb:vortex-file-compressed +7.3% -2.3% +9.9% +11.4% ➖ noise
40 datafusion:vortex-file-compressed +14.2% -0.1% +14.3% +11.6% 🚨 regression
40 duckdb:duckdb -1.2% -0.1% -1.1% +11.4% ➖ noise
40 duckdb:vortex-file-compressed +2.3% -0.1% +2.3% +11.5% ➖ noise
41 datafusion:vortex-file-compressed +4.3% -0.2% +4.5% +10.0% ➖ noise
41 duckdb:duckdb -0.2% -0.2% +0.0% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +11.7% -0.2% +11.9% +10.0% 🚨 regression
42 datafusion:vortex-file-compressed +0.9% +2.2% -1.3% +12.0% ➖ noise
42 duckdb:duckdb -0.9% +2.2% -3.1% +10.4% ➖ noise
42 duckdb:vortex-file-compressed +16.8% +2.2% +14.3% +12.4% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Clickbench on NVME

File Size Changes (101 files changed, -33.3% overall, 0↑ 101↓)
File Scale Format Base HEAD Change %
hits_5.vortex 1.0 vortex-compact 62.68 MB 0 B 62.68 MB -100.0%
hits_11.vortex 1.0 vortex-compact 54.10 MB 0 B 54.10 MB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_30.vortex 1.0 vortex-compact 58.49 MB 0 B 58.49 MB -100.0%
hits_93.vortex 1.0 vortex-compact 58.65 MB 0 B 58.65 MB -100.0%
hits_92.vortex 1.0 vortex-compact 94.00 MB 0 B 94.00 MB -100.0%
hits_87.vortex 1.0 vortex-compact 118.73 MB 0 B 118.73 MB -100.0%
hits_89.vortex 1.0 vortex-compact 112.44 MB 0 B 112.44 MB -100.0%
hits_88.vortex 1.0 vortex-compact 73.07 MB 0 B 73.07 MB -100.0%
hits_54.vortex 1.0 vortex-compact 117.25 MB 0 B 117.25 MB -100.0%
hits_49.vortex 1.0 vortex-compact 50.27 MB 0 B 50.27 MB -100.0%
hits_37.vortex 1.0 vortex-compact 53.60 MB 0 B 53.60 MB -100.0%
hits_60.vortex 1.0 vortex-compact 64.06 MB 0 B 64.06 MB -100.0%
hits_44.vortex 1.0 vortex-compact 132.13 MB 0 B 132.13 MB -100.0%
hits_41.vortex 1.0 vortex-compact 165.44 MB 0 B 165.44 MB -100.0%
hits_95.vortex 1.0 vortex-compact 57.43 MB 0 B 57.43 MB -100.0%
hits_99.vortex 1.0 vortex-compact 77.04 MB 0 B 77.04 MB -100.0%
hits_33.vortex 1.0 vortex-compact 35.72 MB 0 B 35.72 MB -100.0%
hits_23.vortex 1.0 vortex-compact 43.94 MB 0 B 43.94 MB -100.0%
hits_18.vortex 1.0 vortex-compact 64.03 MB 0 B 64.03 MB -100.0%
hits_73.vortex 1.0 vortex-compact 69.77 MB 0 B 69.77 MB -100.0%
hits_91.vortex 1.0 vortex-compact 60.68 MB 0 B 60.68 MB -100.0%
hits_39.vortex 1.0 vortex-compact 49.56 MB 0 B 49.56 MB -100.0%
hits_22.vortex 1.0 vortex-compact 44.47 MB 0 B 44.47 MB -100.0%
hits_19.vortex 1.0 vortex-compact 44.54 MB 0 B 44.54 MB -100.0%
hits_40.vortex 1.0 vortex-compact 75.59 MB 0 B 75.59 MB -100.0%
hits_45.vortex 1.0 vortex-compact 75.67 MB 0 B 75.67 MB -100.0%
hits_34.vortex 1.0 vortex-compact 58.01 MB 0 B 58.01 MB -100.0%
hits_48.vortex 1.0 vortex-compact 17.12 MB 0 B 17.12 MB -100.0%
hits_24.vortex 1.0 vortex-compact 43.39 MB 0 B 43.39 MB -100.0%
hits_66.vortex 1.0 vortex-compact 53.24 MB 0 B 53.24 MB -100.0%
hits_69.vortex 1.0 vortex-compact 80.74 MB 0 B 80.74 MB -100.0%
hits_78.vortex 1.0 vortex-compact 97.53 MB 0 B 97.53 MB -100.0%
hits_50.vortex 1.0 vortex-compact 112.74 MB 0 B 112.74 MB -100.0%
hits_71.vortex 1.0 vortex-compact 69.03 MB 0 B 69.03 MB -100.0%
hits_63.vortex 1.0 vortex-compact 45.88 MB 0 B 45.88 MB -100.0%
hits_21.vortex 1.0 vortex-compact 51.31 MB 0 B 51.31 MB -100.0%
hits_26.vortex 1.0 vortex-compact 70.61 MB 0 B 70.61 MB -100.0%
hits_72.vortex 1.0 vortex-compact 51.54 MB 0 B 51.54 MB -100.0%
hits_43.vortex 1.0 vortex-compact 168.57 MB 0 B 168.57 MB -100.0%
hits_13.vortex 1.0 vortex-compact 67.72 MB 0 B 67.72 MB -100.0%
hits_14.vortex 1.0 vortex-compact 73.51 MB 0 B 73.51 MB -100.0%
hits_9.vortex 1.0 vortex-compact 65.45 MB 0 B 65.45 MB -100.0%
hits_32.vortex 1.0 vortex-compact 43.87 MB 0 B 43.87 MB -100.0%
hits_75.vortex 1.0 vortex-compact 43.42 MB 0 B 43.42 MB -100.0%
hits_27.vortex 1.0 vortex-compact 69.66 MB 0 B 69.66 MB -100.0%
hits_15.vortex 1.0 vortex-compact 47.87 MB 0 B 47.87 MB -100.0%
hits_4.vortex 1.0 vortex-compact 71.53 MB 0 B 71.53 MB -100.0%
hits_28.vortex 1.0 vortex-compact 70.02 MB 0 B 70.02 MB -100.0%
hits_94.vortex 1.0 vortex-compact 90.36 MB 0 B 90.36 MB -100.0%
hits_65.vortex 1.0 vortex-compact 129.46 MB 0 B 129.46 MB -100.0%
hits_29.vortex 1.0 vortex-compact 36.38 MB 0 B 36.38 MB -100.0%
hits_64.vortex 1.0 vortex-compact 53.69 MB 0 B 53.69 MB -100.0%
hits_83.vortex 1.0 vortex-compact 52.30 MB 0 B 52.30 MB -100.0%
hits_79.vortex 1.0 vortex-compact 85.36 MB 0 B 85.36 MB -100.0%
hits_98.vortex 1.0 vortex-compact 72.43 MB 0 B 72.43 MB -100.0%
hits_55.vortex 1.0 vortex-compact 93.42 MB 0 B 93.42 MB -100.0%
hits_80.vortex 1.0 vortex-compact 67.81 MB 0 B 67.81 MB -100.0%
hits_59.vortex 1.0 vortex-compact 65.96 MB 0 B 65.96 MB -100.0%
hits_46.vortex 1.0 vortex-compact 41.61 MB 0 B 41.61 MB -100.0%
hits_36.vortex 1.0 vortex-compact 48.68 MB 0 B 48.68 MB -100.0%
hits_12.vortex 1.0 vortex-compact 69.04 MB 0 B 69.04 MB -100.0%
hits_10.vortex 1.0 vortex-compact 48.67 MB 0 B 48.67 MB -100.0%
hits_62.vortex 1.0 vortex-compact 74.04 MB 0 B 74.04 MB -100.0%
hits_38.vortex 1.0 vortex-compact 62.85 MB 0 B 62.85 MB -100.0%
hits_1.vortex 1.0 vortex-compact 90.07 MB 0 B 90.07 MB -100.0%
hits_25.vortex 1.0 vortex-compact 72.86 MB 0 B 72.86 MB -100.0%
hits_67.vortex 1.0 vortex-compact 113.69 MB 0 B 113.69 MB -100.0%
hits_61.vortex 1.0 vortex-compact 57.40 MB 0 B 57.40 MB -100.0%
hits_82.vortex 1.0 vortex-compact 66.59 MB 0 B 66.59 MB -100.0%
hits_0.vortex 1.0 vortex-compact 58.39 MB 0 B 58.39 MB -100.0%
hits_2.vortex 1.0 vortex-compact 129.05 MB 0 B 129.05 MB -100.0%
hits_68.vortex 1.0 vortex-compact 75.68 MB 0 B 75.68 MB -100.0%
hits_52.vortex 1.0 vortex-compact 63.41 MB 0 B 63.41 MB -100.0%
hits_81.vortex 1.0 vortex-compact 65.21 MB 0 B 65.21 MB -100.0%
hits_57.vortex 1.0 vortex-compact 83.30 MB 0 B 83.30 MB -100.0%
hits_31.vortex 1.0 vortex-compact 55.28 MB 0 B 55.28 MB -100.0%
hits_74.vortex 1.0 vortex-compact 71.37 MB 0 B 71.37 MB -100.0%
hits_20.vortex 1.0 vortex-compact 37.88 MB 0 B 37.88 MB -100.0%
hits_17.vortex 1.0 vortex-compact 58.08 MB 0 B 58.08 MB -100.0%
hits_97.vortex 1.0 vortex-compact 68.90 MB 0 B 68.90 MB -100.0%
hits_90.vortex 1.0 vortex-compact 81.59 MB 0 B 81.59 MB -100.0%
hits_77.vortex 1.0 vortex-compact 117.87 MB 0 B 117.87 MB -100.0%
hits_76.vortex 1.0 vortex-compact 76.12 MB 0 B 76.12 MB -100.0%
hits_6.vortex 1.0 vortex-compact 62.94 MB 0 B 62.94 MB -100.0%
hits_86.vortex 1.0 vortex-compact 47.99 MB 0 B 47.99 MB -100.0%
hits_85.vortex 1.0 vortex-compact 52.51 MB 0 B 52.51 MB -100.0%
hits_3.vortex 1.0 vortex-compact 93.91 MB 0 B 93.91 MB -100.0%
hits_7.vortex 1.0 vortex-compact 63.58 MB 0 B 63.58 MB -100.0%
hits_70.vortex 1.0 vortex-compact 61.06 MB 0 B 61.06 MB -100.0%
hits_8.vortex 1.0 vortex-compact 62.67 MB 0 B 62.67 MB -100.0%
hits_58.vortex 1.0 vortex-compact 60.19 MB 0 B 60.19 MB -100.0%
hits_96.vortex 1.0 vortex-compact 90.83 MB 0 B 90.83 MB -100.0%
hits_35.vortex 1.0 vortex-compact 74.79 MB 0 B 74.79 MB -100.0%
hits_42.vortex 1.0 vortex-compact 163.89 MB 0 B 163.89 MB -100.0%
hits_51.vortex 1.0 vortex-compact 167.28 MB 0 B 167.28 MB -100.0%
hits_53.vortex 1.0 vortex-compact 58.85 MB 0 B 58.85 MB -100.0%
hits_16.vortex 1.0 vortex-compact 48.09 MB 0 B 48.09 MB -100.0%
hits_47.vortex 1.0 vortex-compact 18.06 MB 0 B 18.06 MB -100.0%
hits_56.vortex 1.0 vortex-compact 77.69 MB 0 B 77.69 MB -100.0%
hits_84.vortex 1.0 vortex-compact 72.85 MB 0 B 72.85 MB -100.0%

Totals:

  • vortex-compact: 7.03 GB → 0 B (-100.0%)
  • vortex-file-compressed: 14.08 GB → 14.08 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.9%
Vortex (geomean): 1.018x ➖
Parquet (geomean): 0.989x ➖
Shifts: Parquet (control) -1.1% · Median polish +0.5%


datafusion / vortex-file-compressed (1.071x ➖, 0↑ 4↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 202528760 208673317 0.97
tpch_q02/datafusion:vortex-file-compressed 423499996 471143632 0.90
tpch_q03/datafusion:vortex-file-compressed 375667235 461285169 0.81
tpch_q04/datafusion:vortex-file-compressed 213775629 202788198 1.05
tpch_q05/datafusion:vortex-file-compressed 395865091 371199199 1.07
tpch_q06/datafusion:vortex-file-compressed 291732132 261626321 1.12
tpch_q07/datafusion:vortex-file-compressed 368843978 366138955 1.01
tpch_q08/datafusion:vortex-file-compressed 602026766 513760870 1.17
tpch_q09/datafusion:vortex-file-compressed 395149920 323941389 1.22
tpch_q10/datafusion:vortex-file-compressed 519998512 426878266 1.22
tpch_q11/datafusion:vortex-file-compressed 🚨 382193728 290075292 1.32
tpch_q12/datafusion:vortex-file-compressed 🚨 457982265 311992059 1.47
tpch_q13/datafusion:vortex-file-compressed 220931902 185000749 1.19
tpch_q14/datafusion:vortex-file-compressed 🚨 257242673 180499765 1.43
tpch_q15/datafusion:vortex-file-compressed 🚨 499171260 343878685 1.45
tpch_q16/datafusion:vortex-file-compressed 208569638 209866311 0.99
tpch_q17/datafusion:vortex-file-compressed 340978390 358243709 0.95
tpch_q18/datafusion:vortex-file-compressed 296301782 329706621 0.90
tpch_q19/datafusion:vortex-file-compressed 334714938 382602191 0.87
tpch_q20/datafusion:vortex-file-compressed 337624909 342624618 0.99
tpch_q21/datafusion:vortex-file-compressed 464691042 468275070 0.99
tpch_q22/datafusion:vortex-file-compressed 145370691 174409555 0.83
datafusion / vortex-compact (1.037x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 237944109 237225709 1.00
tpch_q02/datafusion:vortex-compact 438857962 403925057 1.09
tpch_q03/datafusion:vortex-compact 382153694 389751325 0.98
tpch_q04/datafusion:vortex-compact 247270735 225462551 1.10
tpch_q05/datafusion:vortex-compact 373318763 377209006 0.99
tpch_q06/datafusion:vortex-compact 308687029 297619299 1.04
tpch_q07/datafusion:vortex-compact 372275049 375761432 0.99
tpch_q08/datafusion:vortex-compact 531689021 500757452 1.06
tpch_q09/datafusion:vortex-compact 431105141 384103454 1.12
tpch_q10/datafusion:vortex-compact 465558795 408053741 1.14
tpch_q11/datafusion:vortex-compact 287800732 271910691 1.06
tpch_q12/datafusion:vortex-compact 424082643 428796112 0.99
tpch_q13/datafusion:vortex-compact 214236276 182112019 1.18
tpch_q14/datafusion:vortex-compact 243769316 254579045 0.96
tpch_q15/datafusion:vortex-compact 418812313 458463560 0.91
tpch_q16/datafusion:vortex-compact 184684779 180086229 1.03
tpch_q17/datafusion:vortex-compact 304350109 337646785 0.90
tpch_q18/datafusion:vortex-compact 262863298 269137049 0.98
tpch_q19/datafusion:vortex-compact 464589603 482231263 0.96
tpch_q20/datafusion:vortex-compact 505293791 437767224 1.15
tpch_q21/datafusion:vortex-compact 559815122 479108246 1.17
tpch_q22/datafusion:vortex-compact 174597989 161292949 1.08
datafusion / parquet (0.958x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 223183932 232417768 0.96
tpch_q02/datafusion:parquet 439229786 470694283 0.93
tpch_q03/datafusion:parquet 359101542 354350223 1.01
tpch_q04/datafusion:parquet 154921225 171998016 0.90
tpch_q05/datafusion:parquet 493356078 475426415 1.04
tpch_q06/datafusion:parquet 134488281 152112514 0.88
tpch_q07/datafusion:parquet 492352789 616264169 0.80
tpch_q08/datafusion:parquet 623742124 609404733 1.02
tpch_q09/datafusion:parquet 464491956 556873000 0.83
tpch_q10/datafusion:parquet 520264081 567661303 0.92
tpch_q11/datafusion:parquet 334668347 332629039 1.01
tpch_q12/datafusion:parquet 251791441 272372260 0.92
tpch_q13/datafusion:parquet 433965210 544277179 0.80
tpch_q14/datafusion:parquet 253412656 200567171 1.26
tpch_q15/datafusion:parquet 291940476 299074895 0.98
tpch_q16/datafusion:parquet 168039543 207556673 0.81
tpch_q17/datafusion:parquet 349585395 370072902 0.94
tpch_q18/datafusion:parquet 431666308 464520932 0.93
tpch_q19/datafusion:parquet 319336238 327055256 0.98
tpch_q20/datafusion:parquet 332579753 318722173 1.04
tpch_q21/datafusion:parquet 516545840 537358763 0.96
tpch_q22/datafusion:parquet 134117863 103567676 1.29
duckdb / vortex-file-compressed (0.981x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 259882740 286967908 0.91
tpch_q02/duckdb:vortex-file-compressed 953890152 958917611 0.99
tpch_q03/duckdb:vortex-file-compressed 597048573 631834499 0.94
tpch_q04/duckdb:vortex-file-compressed 376074104 438806238 0.86
tpch_q05/duckdb:vortex-file-compressed 918391244 958713244 0.96
tpch_q06/duckdb:vortex-file-compressed 417014326 428885685 0.97
tpch_q07/duckdb:vortex-file-compressed 726787198 805201323 0.90
tpch_q08/duckdb:vortex-file-compressed 916682384 948322897 0.97
tpch_q09/duckdb:vortex-file-compressed 906585812 931792120 0.97
tpch_q10/duckdb:vortex-file-compressed 712929946 758187671 0.94
tpch_q11/duckdb:vortex-file-compressed 524697462 520255445 1.01
tpch_q12/duckdb:vortex-file-compressed 506405074 561423129 0.90
tpch_q13/duckdb:vortex-file-compressed 453519322 536766077 0.84
tpch_q14/duckdb:vortex-file-compressed 469126460 486201364 0.96
tpch_q15/duckdb:vortex-file-compressed 337450135 264862115 1.27
tpch_q16/duckdb:vortex-file-compressed 397404093 396918929 1.00
tpch_q17/duckdb:vortex-file-compressed 684865259 704742749 0.97
tpch_q18/duckdb:vortex-file-compressed 627027025 586825476 1.07
tpch_q19/duckdb:vortex-file-compressed 495190406 436895335 1.13
tpch_q20/duckdb:vortex-file-compressed 888224542 887641718 1.00
tpch_q21/duckdb:vortex-file-compressed 1168007705 1284403183 0.91
tpch_q22/duckdb:vortex-file-compressed 467048931 393891031 1.19
duckdb / vortex-compact (0.985x ➖, 1↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 320896997 292155519 1.10
tpch_q02/duckdb:vortex-compact 1013442498 917530020 1.10
tpch_q03/duckdb:vortex-compact 606080558 567442578 1.07
tpch_q04/duckdb:vortex-compact 367834748 371232200 0.99
tpch_q05/duckdb:vortex-compact 899641909 876415943 1.03
tpch_q06/duckdb:vortex-compact 478962419 375017516 1.28
tpch_q07/duckdb:vortex-compact 738305150 773120108 0.95
tpch_q08/duckdb:vortex-compact 938253910 890548934 1.05
tpch_q09/duckdb:vortex-compact 880574132 936431537 0.94
tpch_q10/duckdb:vortex-compact 697498009 824095423 0.85
tpch_q11/duckdb:vortex-compact 503235671 526643512 0.96
tpch_q12/duckdb:vortex-compact 457482268 483549349 0.95
tpch_q13/duckdb:vortex-compact 437925970 445832128 0.98
tpch_q14/duckdb:vortex-compact 455006608 510934903 0.89
tpch_q15/duckdb:vortex-compact 🚀 315722176 467250712 0.68
tpch_q16/duckdb:vortex-compact 420900006 444132287 0.95
tpch_q17/duckdb:vortex-compact 670712134 674725690 0.99
tpch_q18/duckdb:vortex-compact 512031620 503419182 1.02
tpch_q19/duckdb:vortex-compact 439191450 446305690 0.98
tpch_q20/duckdb:vortex-compact 1005617532 844224531 1.19
tpch_q21/duckdb:vortex-compact 1110984187 1195764408 0.93
tpch_q22/duckdb:vortex-compact 377036901 392875134 0.96
duckdb / parquet (1.022x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 530838456 483555114 1.10
tpch_q02/duckdb:parquet 1423885198 1441788663 0.99
tpch_q03/duckdb:parquet 986360418 1012498898 0.97
tpch_q04/duckdb:parquet 691574845 599061607 1.15
tpch_q05/duckdb:parquet 1624167731 1628938603 1.00
tpch_q06/duckdb:parquet 415933482 417133026 1.00
tpch_q07/duckdb:parquet 1308428749 1398023178 0.94
tpch_q08/duckdb:parquet 1721975043 1562639266 1.10
tpch_q09/duckdb:parquet 1559209619 1422625839 1.10
tpch_q10/duckdb:parquet 1356326361 1328257463 1.02
tpch_q11/duckdb:parquet 920189937 920365242 1.00
tpch_q12/duckdb:parquet 623114190 642952726 0.97
tpch_q13/duckdb:parquet 915394595 905896115 1.01
tpch_q14/duckdb:parquet 707822556 665106845 1.06
tpch_q15/duckdb:parquet 563991060 548433477 1.03
tpch_q16/duckdb:parquet 617175999 590945477 1.04
tpch_q17/duckdb:parquet 784289699 762844561 1.03
tpch_q18/duckdb:parquet 885708873 853271886 1.04
tpch_q19/duckdb:parquet 842100466 894591459 0.94
tpch_q20/duckdb:parquet 1152254076 1143808941 1.01
tpch_q21/duckdb:parquet 1236702796 1249696158 0.99
tpch_q22/duckdb:parquet 571174467 557635138 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +0.3% +2.7% -2.3% +119.7% ➖ noise
1 datafusion:vortex-file-compressed -2.9% +2.7% -5.5% +114.4% ➖ noise
1 duckdb:vortex-compact +9.8% +2.7% +7.0% +42.0% ➖ noise
1 duckdb:vortex-file-compressed -9.4% +2.7% -11.8% +51.7% ➖ noise
2 datafusion:vortex-compact +8.6% -4.0% +13.2% +47.8% ➖ noise
2 datafusion:vortex-file-compressed -10.1% -4.0% -6.4% +30.0% ➖ noise
2 duckdb:vortex-compact +10.5% -4.0% +15.1% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -0.5% -4.0% +3.6% +30.0% ➖ noise
3 datafusion:vortex-compact -1.9% -0.6% -1.3% +72.1% ➖ noise
3 datafusion:vortex-file-compressed -18.6% -0.6% -18.0% +90.8% ➖ noise
3 duckdb:vortex-compact +6.8% -0.6% +7.5% +32.1% ➖ noise
3 duckdb:vortex-file-compressed -5.5% -0.6% -4.9% +34.9% ➖ noise
4 datafusion:vortex-compact +9.7% +2.0% +7.6% +38.2% ➖ noise
4 datafusion:vortex-file-compressed +5.4% +2.0% +3.4% +30.0% ➖ noise
4 duckdb:vortex-compact -0.9% +2.0% -2.8% +46.6% ➖ noise
4 duckdb:vortex-file-compressed -14.3% +2.0% -16.0% +30.0% ➖ noise
5 datafusion:vortex-compact -1.0% +1.7% -2.7% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +6.6% +1.7% +4.8% +30.0% ➖ noise
5 duckdb:vortex-compact +2.7% +1.7% +0.9% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -4.2% +1.7% -5.8% +30.0% ➖ noise
6 datafusion:vortex-compact +3.7% -6.1% +10.5% +42.5% ➖ noise
6 datafusion:vortex-file-compressed +11.5% -6.1% +18.8% +30.0% ➖ noise
6 duckdb:vortex-compact +27.7% -6.1% +36.0% +30.0% 🚨 regression
6 duckdb:vortex-file-compressed -2.8% -6.1% +3.6% +30.0% ➖ noise
7 datafusion:vortex-compact -0.9% -13.5% +14.6% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +0.7% -13.5% +16.5% +30.0% ➖ noise
7 duckdb:vortex-compact -4.5% -13.5% +10.4% +39.4% ➖ noise
7 duckdb:vortex-file-compressed -9.7% -13.5% +4.4% +30.0% ➖ noise
8 datafusion:vortex-compact +6.2% +6.2% -0.0% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +17.2% +6.2% +10.3% +30.0% ➖ noise
8 duckdb:vortex-compact +5.4% +6.2% -0.8% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -3.3% +6.2% -9.0% +30.0% ➖ noise
9 datafusion:vortex-compact +12.2% -4.4% +17.4% +34.5% ➖ noise
9 datafusion:vortex-file-compressed +22.0% -4.4% +27.6% +30.0% ➖ noise
9 duckdb:vortex-compact -6.0% -4.4% -1.7% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -2.7% -4.4% +1.8% +30.0% ➖ noise
10 datafusion:vortex-compact +14.1% -3.3% +17.9% +30.0% ➖ noise
10 datafusion:vortex-file-compressed +21.8% -3.3% +25.9% +30.0% ➖ noise
10 duckdb:vortex-compact -15.4% -3.3% -12.5% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -6.0% -3.3% -2.8% +30.0% ➖ noise
11 datafusion:vortex-compact +5.8% +0.3% +5.5% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +31.8% +0.3% +31.4% +30.0% 🚨 regression
11 duckdb:vortex-compact -4.4% +0.3% -4.7% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +0.9% +0.3% +0.6% +30.0% ➖ noise
12 datafusion:vortex-compact -1.1% -5.3% +4.5% +30.0% ➖ noise
12 datafusion:vortex-file-compressed +46.8% -5.3% +55.1% +38.3% 🚨 regression
12 duckdb:vortex-compact -5.4% -5.3% -0.0% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -9.8% -5.3% -4.7% +30.0% ➖ noise
13 datafusion:vortex-compact +17.6% -10.2% +31.1% +73.4% ➖ noise
13 datafusion:vortex-file-compressed +19.4% -10.2% +33.0% +93.8% ➖ noise
13 duckdb:vortex-compact -1.8% -10.2% +9.4% +46.5% ➖ noise
13 duckdb:vortex-file-compressed -15.5% -10.2% -5.9% +38.3% ➖ noise
14 datafusion:vortex-compact -4.2% +16.0% -17.4% +30.0% ➖ noise
14 datafusion:vortex-file-compressed +42.5% +16.0% +22.9% +69.6% ➖ noise
14 duckdb:vortex-compact -10.9% +16.0% -23.2% +33.4% ➖ noise
14 duckdb:vortex-file-compressed -3.5% +16.0% -16.8% +30.0% ➖ noise
15 datafusion:vortex-compact -8.6% +0.2% -8.8% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +45.2% +0.2% +44.9% +59.4% ➖ noise
15 duckdb:vortex-compact -32.4% +0.2% -32.6% +101.0% ➖ noise
15 duckdb:vortex-file-compressed +27.4% +0.2% +27.2% +30.0% ➖ noise
16 datafusion:vortex-compact +2.6% -8.0% +11.5% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -0.6% -8.0% +8.1% +76.6% ➖ noise
16 duckdb:vortex-compact -5.2% -8.0% +3.1% +36.2% ➖ noise
16 duckdb:vortex-file-compressed +0.1% -8.0% +8.9% +30.0% ➖ noise
17 datafusion:vortex-compact -9.9% -1.5% -8.5% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -4.8% -1.5% -3.4% +30.0% ➖ noise
17 duckdb:vortex-compact -0.6% -1.5% +0.9% +52.2% ➖ noise
17 duckdb:vortex-file-compressed -2.8% -1.5% -1.4% +30.0% ➖ noise
18 datafusion:vortex-compact -2.3% -1.8% -0.6% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -10.1% -1.8% -8.5% +30.5% ➖ noise
18 duckdb:vortex-compact +1.7% -1.8% +3.6% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +6.9% -1.8% +8.8% +30.0% ➖ noise
19 datafusion:vortex-compact -3.7% -4.1% +0.5% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -12.5% -4.1% -8.7% +30.0% ➖ noise
19 duckdb:vortex-compact -1.6% -4.1% +2.6% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +13.3% -4.1% +18.2% +30.0% ➖ noise
20 datafusion:vortex-compact +15.4% +2.5% +12.6% +37.6% ➖ noise
20 datafusion:vortex-file-compressed -1.5% +2.5% -3.9% +30.0% ➖ noise
20 duckdb:vortex-compact +19.1% +2.5% +16.2% +33.5% ➖ noise
20 duckdb:vortex-file-compressed +0.1% +2.5% -2.4% +30.0% ➖ noise
21 datafusion:vortex-compact +16.8% -2.5% +19.8% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -0.8% -2.5% +1.7% +30.0% ➖ noise
21 duckdb:vortex-compact -7.1% -2.5% -4.7% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -9.1% -2.5% -6.8% +30.0% ➖ noise
22 datafusion:vortex-compact +8.2% +15.2% -6.0% +32.7% ➖ noise
22 datafusion:vortex-file-compressed -16.6% +15.2% -27.6% +30.0% ✅ faster
22 duckdb:vortex-compact -4.0% +15.2% -16.7% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +18.6% +15.2% +3.0% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.6%
Vortex (geomean): 0.982x ➖
Parquet (geomean): 1.008x ➖
Shifts: Parquet (control) +0.8% · Median polish +0.1%


datafusion / vortex-file-compressed (0.975x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 30429456 35652854 0.85
fineweb_q01/datafusion:vortex-file-compressed 492977905 569164962 0.87
fineweb_q02/datafusion:vortex-file-compressed 506829714 468413704 1.08
fineweb_q03/datafusion:vortex-file-compressed 1384946172 1353149281 1.02
fineweb_q04/datafusion:vortex-file-compressed 1373359519 1350886151 1.02
fineweb_q05/datafusion:vortex-file-compressed 1342594781 1349328711 1.00
fineweb_q06/datafusion:vortex-file-compressed 1474268951 1420192164 1.04
fineweb_q07/datafusion:vortex-file-compressed 1341331854 1344806866 1.00
fineweb_q08/datafusion:vortex-file-compressed 542556040 585781769 0.93
datafusion / vortex-compact (0.935x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 28729370 28705189 1.00
fineweb_q01/datafusion:vortex-compact 536685327 669550403 0.80
fineweb_q02/datafusion:vortex-compact 672086940 860906547 0.78
fineweb_q03/datafusion:vortex-compact 1846614960 1823553673 1.01
fineweb_q04/datafusion:vortex-compact 2237819128 2227300883 1.00
fineweb_q05/datafusion:vortex-compact 1671773098 1654337750 1.01
fineweb_q06/datafusion:vortex-compact 1383076765 1438211084 0.96
fineweb_q07/datafusion:vortex-compact 1359011068 1362109744 1.00
fineweb_q08/datafusion:vortex-compact 396299035 449130960 0.88
datafusion / parquet (1.024x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1247750420 1323225328 0.94
fineweb_q01/datafusion:parquet 1771485977 1830581857 0.97
fineweb_q02/datafusion:parquet 1786648396 1695758463 1.05
fineweb_q03/datafusion:parquet 1947933884 1655543278 1.18
fineweb_q04/datafusion:parquet 1910067036 1809371105 1.06
fineweb_q05/datafusion:parquet 1838649046 1754466297 1.05
fineweb_q06/datafusion:parquet 1830376595 1725007245 1.06
fineweb_q07/datafusion:parquet 1782003738 1727016806 1.03
fineweb_q08/datafusion:parquet 1714948449 1903969739 0.90
duckdb / vortex-file-compressed (0.993x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 93447333 85158841 1.10
fineweb_q01/duckdb:vortex-file-compressed 555944596 606689044 0.92
fineweb_q02/duckdb:vortex-file-compressed 530050873 455111899 1.16
fineweb_q03/duckdb:vortex-file-compressed 1467599594 1571261333 0.93
fineweb_q04/duckdb:vortex-file-compressed 1521426844 1599431438 0.95
fineweb_q05/duckdb:vortex-file-compressed 1487878913 1577529975 0.94
fineweb_q06/duckdb:vortex-file-compressed 1670672472 1645817688 1.02
fineweb_q07/duckdb:vortex-file-compressed 1613793341 1697656802 0.95
fineweb_q08/duckdb:vortex-file-compressed 652229382 659124566 0.99
duckdb / vortex-compact (1.028x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 76823432 90530585 0.85
fineweb_q01/duckdb:vortex-compact 614304241 539155014 1.14
fineweb_q02/duckdb:vortex-compact 656037342 616972302 1.06
fineweb_q03/duckdb:vortex-compact 1775316024 1674229845 1.06
fineweb_q04/duckdb:vortex-compact 1892353342 1832868436 1.03
fineweb_q05/duckdb:vortex-compact 1682016140 1592659893 1.06
fineweb_q06/duckdb:vortex-compact 1636643007 1419743275 1.15
fineweb_q07/duckdb:vortex-compact 1442447661 1367975897 1.05
fineweb_q08/duckdb:vortex-compact 492938017 557835748 0.88
duckdb / parquet (0.992x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1106465866 1074731286 1.03
fineweb_q01/duckdb:parquet 1615308572 1607147998 1.01
fineweb_q02/duckdb:parquet 1632886511 1614158003 1.01
fineweb_q03/duckdb:parquet 4015280503 3991629082 1.01
fineweb_q04/duckdb:parquet 1863915464 2018974749 0.92
fineweb_q05/duckdb:parquet 2674332623 2646780219 1.01
fineweb_q06/duckdb:parquet 3354626050 3515605196 0.95
fineweb_q07/duckdb:parquet 4052609710 4076354601 0.99
fineweb_q08/duckdb:parquet 1123601028 1121323684 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +0.1% -1.5% +1.6% +148.8% ➖ noise
0 datafusion:vortex-file-compressed -14.7% -1.5% -13.4% +139.0% ➖ noise
0 duckdb:vortex-compact -15.1% -1.5% -13.9% +83.4% ➖ noise
0 duckdb:vortex-file-compressed +9.7% -1.5% +11.4% +42.2% ➖ noise
1 datafusion:vortex-compact -19.8% -1.4% -18.7% +48.9% ➖ noise
1 datafusion:vortex-file-compressed -13.4% -1.4% -12.2% +76.0% ➖ noise
1 duckdb:vortex-compact +13.9% -1.4% +15.5% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -8.4% -1.4% -7.1% +30.0% ➖ noise
2 datafusion:vortex-compact -21.9% +3.2% -24.4% +32.5% ➖ noise
2 datafusion:vortex-file-compressed +8.2% +3.2% +4.8% +30.0% ➖ noise
2 duckdb:vortex-compact +6.3% +3.2% +3.0% +33.2% ➖ noise
2 duckdb:vortex-file-compressed +16.5% +3.2% +12.8% +30.0% ➖ noise
3 datafusion:vortex-compact +1.3% +8.8% -6.9% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +2.3% +8.8% -5.9% +30.0% ➖ noise
3 duckdb:vortex-compact +6.0% +8.8% -2.5% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -6.6% +8.8% -14.1% +30.0% ➖ noise
4 datafusion:vortex-compact +0.5% -1.3% +1.8% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +1.7% -1.3% +3.0% +30.0% ➖ noise
4 duckdb:vortex-compact +3.2% -1.3% +4.6% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -4.9% -1.3% -3.6% +30.0% ➖ noise
5 datafusion:vortex-compact +1.1% +2.9% -1.8% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -0.5% +2.9% -3.3% +30.0% ➖ noise
5 duckdb:vortex-compact +5.6% +2.9% +2.6% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -5.7% +2.9% -8.3% +30.0% ➖ noise
6 datafusion:vortex-compact -3.8% +0.6% -4.4% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +3.8% +0.6% +3.2% +30.0% ➖ noise
6 duckdb:vortex-compact +15.3% +0.6% +14.6% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +1.5% +0.6% +0.9% +30.0% ➖ noise
7 datafusion:vortex-compact -0.2% +1.3% -1.5% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -0.3% +1.3% -1.5% +30.0% ➖ noise
7 duckdb:vortex-compact +5.4% +1.3% +4.1% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -4.9% +1.3% -6.1% +35.2% ➖ noise
8 datafusion:vortex-compact -11.8% -5.0% -7.1% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -7.4% -5.0% -2.5% +30.0% ➖ noise
8 duckdb:vortex-compact -11.6% -5.0% -7.0% +30.9% ➖ noise
8 duckdb:vortex-file-compressed -1.0% -5.0% +4.2% +30.0% ➖ noise

Copy link
Copy Markdown
Contributor

@joseph-isaacs joseph-isaacs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Where do we create this execution ctx.

This idea is that this should never happen.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +4.8%
Vortex (geomean): 1.016x ➖
Parquet (geomean): 0.969x ➖
Shifts: Parquet (control) -3.1% · Median polish +0.3%


datafusion / vortex-file-compressed (1.025x ➖, 0↑ 1↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 677477509 677746611 1.00
tpch_q02/datafusion:vortex-file-compressed 655053050 646505477 1.01
tpch_q03/datafusion:vortex-file-compressed 🚨 997014018 752634408 1.32
tpch_q04/datafusion:vortex-file-compressed 630957864 631088438 1.00
tpch_q05/datafusion:vortex-file-compressed 1214505028 1016174776 1.20
tpch_q06/datafusion:vortex-file-compressed 638078511 648554983 0.98
tpch_q07/datafusion:vortex-file-compressed 1044995146 1020115992 1.02
tpch_q08/datafusion:vortex-file-compressed 1376127077 1114683155 1.23
tpch_q09/datafusion:vortex-file-compressed 1531923341 1407463989 1.09
tpch_q10/datafusion:vortex-file-compressed 1161116157 1004524570 1.16
tpch_q11/datafusion:vortex-file-compressed 539417061 462347309 1.17
tpch_q12/datafusion:vortex-file-compressed 934775998 863739331 1.08
tpch_q13/datafusion:vortex-file-compressed 454918709 489536296 0.93
tpch_q14/datafusion:vortex-file-compressed 598064563 669147373 0.89
tpch_q15/datafusion:vortex-file-compressed 1324331341 1127427847 1.17
tpch_q16/datafusion:vortex-file-compressed 326235131 404721694 0.81
tpch_q17/datafusion:vortex-file-compressed 1180000042 1133910247 1.04
tpch_q18/datafusion:vortex-file-compressed 1262862551 1326604829 0.95
tpch_q19/datafusion:vortex-file-compressed 798155598 724220751 1.10
tpch_q20/datafusion:vortex-file-compressed 889021105 1004703869 0.88
tpch_q21/datafusion:vortex-file-compressed 1588766870 1917686521 0.83
tpch_q22/datafusion:vortex-file-compressed 363667675 418980274 0.87
datafusion / vortex-compact (0.972x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 775015417 772044511 1.00
tpch_q02/datafusion:vortex-compact 649870569 834724020 0.78
tpch_q03/datafusion:vortex-compact 768871998 847453018 0.91
tpch_q04/datafusion:vortex-compact 651016163 605066885 1.08
tpch_q05/datafusion:vortex-compact 1011219717 945444089 1.07
tpch_q06/datafusion:vortex-compact 617121826 540782896 1.14
tpch_q07/datafusion:vortex-compact 1081952652 1039462833 1.04
tpch_q08/datafusion:vortex-compact 1147650602 1191436995 0.96
tpch_q09/datafusion:vortex-compact 1196324567 1434263451 0.83
tpch_q10/datafusion:vortex-compact 892204199 1103973529 0.81
tpch_q11/datafusion:vortex-compact 412291139 550598485 0.75
tpch_q12/datafusion:vortex-compact 975080682 839708032 1.16
tpch_q13/datafusion:vortex-compact 403472774 408604959 0.99
tpch_q14/datafusion:vortex-compact 790325150 612856904 1.29
tpch_q15/datafusion:vortex-compact 1131422147 1185564774 0.95
tpch_q16/datafusion:vortex-compact 320735609 329739673 0.97
tpch_q17/datafusion:vortex-compact 1142806456 1188657116 0.96
tpch_q18/datafusion:vortex-compact 1150418838 1139733224 1.01
tpch_q19/datafusion:vortex-compact 782344755 776200163 1.01
tpch_q20/datafusion:vortex-compact 915537752 798817397 1.15
tpch_q21/datafusion:vortex-compact 1396700856 1395233237 1.00
tpch_q22/datafusion:vortex-compact 360438098 484244078 0.74
datafusion / parquet (0.959x ➖, 2↑ 1↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 843972498 847406184 1.00
tpch_q02/datafusion:parquet 666699252 692673210 0.96
tpch_q03/datafusion:parquet 880880546 1019318090 0.86
tpch_q04/datafusion:parquet 465016941 469742880 0.99
tpch_q05/datafusion:parquet 1272837634 1161315005 1.10
tpch_q06/datafusion:parquet 541807226 528680179 1.02
tpch_q07/datafusion:parquet 1522573132 1185528991 1.28
tpch_q08/datafusion:parquet 1673011421 1511088015 1.11
tpch_q09/datafusion:parquet 1878984381 1745260513 1.08
tpch_q10/datafusion:parquet 2044293159 1957629352 1.04
tpch_q11/datafusion:parquet 502333342 550013672 0.91
tpch_q12/datafusion:parquet 704117057 652153648 1.08
tpch_q13/datafusion:parquet 742284248 688737294 1.08
tpch_q14/datafusion:parquet 810416764 730514937 1.11
tpch_q15/datafusion:parquet 1227822450 1299454776 0.94
tpch_q16/datafusion:parquet 🚨 460910461 339906791 1.36
tpch_q17/datafusion:parquet 1338413462 1335916198 1.00
tpch_q18/datafusion:parquet 1465574911 1621752339 0.90
tpch_q19/datafusion:parquet 915647858 1010362564 0.91
tpch_q20/datafusion:parquet 1114679560 1111550691 1.00
tpch_q21/datafusion:parquet 🚀 1870441608 2970396254 0.63
tpch_q22/datafusion:parquet 🚀 815807426 2339825165 0.35
duckdb / vortex-file-compressed (1.072x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 651982670 636958430 1.02
tpch_q02/duckdb:vortex-file-compressed 1297499924 1272152169 1.02
tpch_q03/duckdb:vortex-file-compressed 1039697831 1010438829 1.03
tpch_q04/duckdb:vortex-file-compressed 741825459 702634825 1.06
tpch_q05/duckdb:vortex-file-compressed 1270188539 1218658675 1.04
tpch_q06/duckdb:vortex-file-compressed 937822050 974626934 0.96
tpch_q07/duckdb:vortex-file-compressed 1384315477 1260967496 1.10
tpch_q08/duckdb:vortex-file-compressed 1596548462 1418688520 1.13
tpch_q09/duckdb:vortex-file-compressed 1741300216 1530568264 1.14
tpch_q10/duckdb:vortex-file-compressed 1109646777 1168672891 0.95
tpch_q11/duckdb:vortex-file-compressed 708795754 671815717 1.06
tpch_q12/duckdb:vortex-file-compressed 866143562 748887316 1.16
tpch_q13/duckdb:vortex-file-compressed 918041575 945064964 0.97
tpch_q14/duckdb:vortex-file-compressed 878072512 867730706 1.01
tpch_q15/duckdb:vortex-file-compressed 594983471 584205749 1.02
tpch_q16/duckdb:vortex-file-compressed 563374344 552129989 1.02
tpch_q17/duckdb:vortex-file-compressed 1006325961 1049799842 0.96
tpch_q18/duckdb:vortex-file-compressed 1051650272 859267924 1.22
tpch_q19/duckdb:vortex-file-compressed 834255727 748405425 1.11
tpch_q20/duckdb:vortex-file-compressed 1519646354 1284339590 1.18
tpch_q21/duckdb:vortex-file-compressed 2507140504 2076211093 1.21
tpch_q22/duckdb:vortex-file-compressed 812780638 627592479 1.30
duckdb / vortex-compact (0.997x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 642638140 652228812 0.99
tpch_q02/duckdb:vortex-compact 1152877896 1258089979 0.92
tpch_q03/duckdb:vortex-compact 974165337 1016817302 0.96
tpch_q04/duckdb:vortex-compact 528003665 561391665 0.94
tpch_q05/duckdb:vortex-compact 1037999876 1190200661 0.87
tpch_q06/duckdb:vortex-compact 750802089 762299849 0.98
tpch_q07/duckdb:vortex-compact 1103062546 1033774160 1.07
tpch_q08/duckdb:vortex-compact 1572865293 1457857830 1.08
tpch_q09/duckdb:vortex-compact 1469272219 1403751039 1.05
tpch_q10/duckdb:vortex-compact 1154792302 1066263893 1.08
tpch_q11/duckdb:vortex-compact 782705272 753369978 1.04
tpch_q12/duckdb:vortex-compact 687408245 718696999 0.96
tpch_q13/duckdb:vortex-compact 865688046 920260370 0.94
tpch_q14/duckdb:vortex-compact 843688736 865582657 0.97
tpch_q15/duckdb:vortex-compact 560752727 560241135 1.00
tpch_q16/duckdb:vortex-compact 460416810 447380682 1.03
tpch_q17/duckdb:vortex-compact 953236459 978117798 0.97
tpch_q18/duckdb:vortex-compact 736388322 770569147 0.96
tpch_q19/duckdb:vortex-compact 843875468 775442332 1.09
tpch_q20/duckdb:vortex-compact 1329909912 1437622337 0.93
tpch_q21/duckdb:vortex-compact 1919429223 1721990050 1.11
tpch_q22/duckdb:vortex-compact 770573964 733997913 1.05
duckdb / parquet (0.979x ➖, 0↑ 0↓)
name PR c0adb3e (ns) base 71089dd (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 982976756 1141017990 0.86
tpch_q02/duckdb:parquet 1704837186 1718413110 0.99
tpch_q03/duckdb:parquet 1697212100 1850641186 0.92
tpch_q04/duckdb:parquet 1014780011 1114946891 0.91
tpch_q05/duckdb:parquet 2160592372 2288546512 0.94
tpch_q06/duckdb:parquet 776201911 781239875 0.99
tpch_q07/duckdb:parquet 1992750201 1990294665 1.00
tpch_q08/duckdb:parquet 2702002030 2611780232 1.03
tpch_q09/duckdb:parquet 2338516280 2784416213 0.84
tpch_q10/duckdb:parquet 3470815439 3287815089 1.06
tpch_q11/duckdb:parquet 1131944585 1226989976 0.92
tpch_q12/duckdb:parquet 1096734947 1007866238 1.09
tpch_q13/duckdb:parquet 1277363186 1462615079 0.87
tpch_q14/duckdb:parquet 1398863065 1216786733 1.15
tpch_q15/duckdb:parquet 941013838 885797596 1.06
tpch_q16/duckdb:parquet 855556842 892495785 0.96
tpch_q17/duckdb:parquet 1350197896 1357638411 0.99
tpch_q18/duckdb:parquet 1598100339 1358731303 1.18
tpch_q19/duckdb:parquet 1656467821 1691492355 0.98
tpch_q20/duckdb:parquet 1937306863 2162989520 0.90
tpch_q21/duckdb:parquet 2179218993 2122840261 1.03
tpch_q22/duckdb:parquet 1093846629 1163870061 0.94
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +0.4% -7.4% +8.4% +57.2% ➖ noise
1 datafusion:vortex-file-compressed -0.0% -7.4% +7.9% +74.1% ➖ noise
1 duckdb:vortex-compact -1.5% -7.4% +6.4% +45.2% ➖ noise
1 duckdb:vortex-file-compressed +2.4% -7.4% +10.5% +45.2% ➖ noise
2 datafusion:vortex-compact -22.1% -2.3% -20.3% +47.3% ➖ noise
2 datafusion:vortex-file-compressed +1.3% -2.3% +3.7% +71.0% ➖ noise
2 duckdb:vortex-compact -8.4% -2.3% -6.2% +45.2% ➖ noise
2 duckdb:vortex-file-compressed +2.0% -2.3% +4.4% +45.2% ➖ noise
3 datafusion:vortex-compact -9.3% -11.0% +1.9% +74.1% ➖ noise
3 datafusion:vortex-file-compressed +32.5% -11.0% +48.8% +70.7% ➖ noise
3 duckdb:vortex-compact -4.2% -11.0% +7.6% +57.6% ➖ noise
3 duckdb:vortex-file-compressed +2.9% -11.0% +15.6% +52.2% ➖ noise
4 datafusion:vortex-compact +7.6% -5.1% +13.4% +46.0% ➖ noise
4 datafusion:vortex-file-compressed -0.0% -5.1% +5.3% +45.2% ➖ noise
4 duckdb:vortex-compact -5.9% -5.1% -0.9% +45.5% ➖ noise
4 duckdb:vortex-file-compressed +5.6% -5.1% +11.2% +45.2% ➖ noise
5 datafusion:vortex-compact +7.0% +1.7% +5.1% +45.2% ➖ noise
5 datafusion:vortex-file-compressed +19.5% +1.7% +17.5% +45.2% ➖ noise
5 duckdb:vortex-compact -12.8% +1.7% -14.3% +45.2% ➖ noise
5 duckdb:vortex-file-compressed +4.2% +1.7% +2.5% +45.2% ➖ noise
6 datafusion:vortex-compact +14.1% +0.9% +13.1% +45.2% ➖ noise
6 datafusion:vortex-file-compressed -1.6% +0.9% -2.5% +45.2% ➖ noise
6 duckdb:vortex-compact -1.5% +0.9% -2.4% +45.2% ➖ noise
6 duckdb:vortex-file-compressed -3.8% +0.9% -4.6% +45.2% ➖ noise
7 datafusion:vortex-compact +4.1% +13.4% -8.2% +45.2% ➖ noise
7 datafusion:vortex-file-compressed +2.4% +13.4% -9.7% +45.2% ➖ noise
7 duckdb:vortex-compact +6.7% +13.4% -5.9% +45.2% ➖ noise
7 duckdb:vortex-file-compressed +9.8% +13.4% -3.2% +45.2% ➖ noise
8 datafusion:vortex-compact -3.7% +7.0% -10.0% +45.2% ➖ noise
8 datafusion:vortex-file-compressed +23.5% +7.0% +15.4% +45.2% ➖ noise
8 duckdb:vortex-compact +7.9% +7.0% +0.8% +45.2% ➖ noise
8 duckdb:vortex-file-compressed +12.5% +7.0% +5.2% +45.2% ➖ noise
9 datafusion:vortex-compact -16.6% -4.9% -12.3% +45.2% ➖ noise
9 datafusion:vortex-file-compressed +8.8% -4.9% +14.5% +45.2% ➖ noise
9 duckdb:vortex-compact +4.7% -4.9% +10.1% +45.2% ➖ noise
9 duckdb:vortex-file-compressed +13.8% -4.9% +19.6% +45.2% ➖ noise
10 datafusion:vortex-compact -19.2% +5.0% -23.0% +45.2% ➖ noise
10 datafusion:vortex-file-compressed +15.6% +5.0% +10.1% +45.2% ➖ noise
10 duckdb:vortex-compact +8.3% +5.0% +3.2% +45.2% ➖ noise
10 duckdb:vortex-file-compressed -5.1% +5.0% -9.6% +45.2% ➖ noise
11 datafusion:vortex-compact -25.1% -8.2% -18.4% +49.0% ➖ noise
11 datafusion:vortex-file-compressed +16.7% -8.2% +27.1% +45.2% ➖ noise
11 duckdb:vortex-compact +3.9% -8.2% +13.2% +45.2% ➖ noise
11 duckdb:vortex-file-compressed +5.5% -8.2% +14.9% +45.2% ➖ noise
12 datafusion:vortex-compact +16.1% +8.4% +7.1% +45.2% ➖ noise
12 datafusion:vortex-file-compressed +8.2% +8.4% -0.2% +45.2% ➖ noise
12 duckdb:vortex-compact -4.4% +8.4% -11.8% +45.2% ➖ noise
12 duckdb:vortex-file-compressed +15.7% +8.4% +6.7% +45.2% ➖ noise
13 datafusion:vortex-compact -1.3% -3.0% +1.8% +49.9% ➖ noise
13 datafusion:vortex-file-compressed -7.1% -3.0% -4.2% +45.2% ➖ noise
13 duckdb:vortex-compact -5.9% -3.0% -3.0% +69.7% ➖ noise
13 duckdb:vortex-file-compressed -2.9% -3.0% +0.1% +72.9% ➖ noise
14 datafusion:vortex-compact +29.0% +12.9% +14.2% +45.2% ➖ noise
14 datafusion:vortex-file-compressed -10.6% +12.9% -20.9% +45.2% ➖ noise
14 duckdb:vortex-compact -2.5% +12.9% -13.7% +45.2% ➖ noise
14 duckdb:vortex-file-compressed +1.2% +12.9% -10.4% +45.2% ➖ noise
15 datafusion:vortex-compact -4.6% +0.2% -4.7% +45.2% ➖ noise
15 datafusion:vortex-file-compressed +17.5% +0.2% +17.2% +45.2% ➖ noise
15 duckdb:vortex-compact +0.1% +0.2% -0.1% +45.2% ➖ noise
15 duckdb:vortex-file-compressed +1.8% +0.2% +1.7% +45.2% ➖ noise
16 datafusion:vortex-compact -2.7% +14.0% -14.7% +45.2% ➖ noise
16 datafusion:vortex-file-compressed -19.4% +14.0% -29.3% +45.2% ➖ noise
16 duckdb:vortex-compact +2.9% +14.0% -9.7% +45.2% ➖ noise
16 duckdb:vortex-file-compressed +2.0% +14.0% -10.5% +45.2% ➖ noise
17 datafusion:vortex-compact -3.9% -0.2% -3.7% +45.2% ➖ noise
17 datafusion:vortex-file-compressed +4.1% -0.2% +4.3% +45.2% ➖ noise
17 duckdb:vortex-compact -2.5% -0.2% -2.4% +45.2% ➖ noise
17 duckdb:vortex-file-compressed -4.1% -0.2% -4.0% +45.2% ➖ noise
18 datafusion:vortex-compact +0.9% +3.1% -2.1% +45.2% ➖ noise
18 datafusion:vortex-file-compressed -4.8% +3.1% -7.7% +45.2% ➖ noise
18 duckdb:vortex-compact -4.4% +3.1% -7.3% +45.2% ➖ noise
18 duckdb:vortex-file-compressed +22.4% +3.1% +18.7% +45.2% ➖ noise
19 datafusion:vortex-compact +0.8% -5.8% +7.0% +45.2% ➖ noise
19 datafusion:vortex-file-compressed +10.2% -5.8% +17.0% +45.2% ➖ noise
19 duckdb:vortex-compact +8.8% -5.8% +15.5% +45.2% ➖ noise
19 duckdb:vortex-file-compressed +11.5% -5.8% +18.3% +45.2% ➖ noise
20 datafusion:vortex-compact +14.6% -5.2% +20.9% +45.2% ➖ noise
20 datafusion:vortex-file-compressed -11.5% -5.2% -6.6% +45.2% ➖ noise
20 duckdb:vortex-compact -7.5% -5.2% -2.4% +45.2% ➖ noise
20 duckdb:vortex-file-compressed +18.3% -5.2% +24.8% +45.2% ➖ noise
21 datafusion:vortex-compact +0.1% -19.6% +24.5% +45.2% ➖ noise
21 datafusion:vortex-file-compressed -17.2% -19.6% +3.0% +45.2% ➖ noise
21 duckdb:vortex-compact +11.5% -19.6% +38.6% +45.2% ➖ noise
21 duckdb:vortex-file-compressed +20.8% -19.6% +50.2% +45.2% 🚨 regression
22 datafusion:vortex-compact -25.6% -42.8% +30.0% +55.4% ➖ noise
22 datafusion:vortex-file-compressed -13.2% -42.8% +51.6% +54.1% ➖ noise
22 duckdb:vortex-compact +5.0% -42.8% +83.4% +45.2% 🚨 regression
22 duckdb:vortex-file-compressed +29.5% -42.8% +126.2% +46.1% 🚨 regression

patch_indices is always Primitive after execution (enforced by
require_child! in Patched::execute), and PrimitiveArray::slice returns
a PrimitiveArray directly. Replace the optimize + execute chain with a
zero-cost try_downcast, removing the last LEGACY_SESSION.create_execution_ctx()
from the scalar_at hot path.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Signed-off-by: Alexander Droste <alexander.droste@protonmail.com>
@0ax1
Copy link
Copy Markdown
Contributor Author

0ax1 commented Apr 13, 2026

Where do we create this execution ctx.

This idea is that this should never happen.

We did in Patched. Removed as part of f70e241.

@0ax1 0ax1 requested a review from joseph-isaacs April 13, 2026 18:27
@0ax1 0ax1 enabled auto-merge (squash) April 13, 2026 18:27
Comment thread encodings/zstd/src/array.rs Outdated
Comment thread encodings/pco/src/array.rs Outdated
Comment thread encodings/zstd/src/array.rs
Signed-off-by: Alexander Droste <alexander.droste@protonmail.com>
Comment thread vortex-array/src/arrays/patched/vtable/operations.rs
@0ax1
Copy link
Copy Markdown
Contributor Author

0ax1 commented Apr 13, 2026

As discussed offline with @joseph-isaacs, we for now want to keep the API as is.

@0ax1 0ax1 closed this Apr 13, 2026
auto-merge was automatically disabled April 13, 2026 18:57

Pull request was closed

@0ax1 0ax1 deleted the ad/remove-ctx-from-scalar-at branch April 14, 2026 08:42
@joseph-isaacs
Copy link
Copy Markdown
Contributor

Sorry to close this. We in the future highly likely want to use the execution context thorough out execution. I think for now we should accept this perf loss.

We can re-examine this in the future.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants